Metalenses harness AI for high-resolution, full-color imaging for compact optical systems

by

Editors' notes

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

peer-reviewed publication

trusted source

proofread

A metalens, composed of an array of nanostructures with arbitrary rotational angles, acquires an image, which is restored to generate an output image that closely approximates the quality of the original "ground truth" image. Credit: Advanced Photonics (2024). DOI: 10.1117/1.AP.6.6.066002

Modern imaging systems, such as those used in smartphones, virtual reality (VR), and augmented reality (AR) devices, are constantly evolving to become more compact, efficient, and high-performing. Traditional optical systems rely on bulky glass lenses, which have limitations like chromatic aberrations, low efficiency at multiple wavelengths, and large physical sizes. These drawbacks present challenges when designing smaller, lighter systems that still produce high-quality images.

To overcome these issues, researchers have developed metalenses—ultra-thin lenses composed of tiny nanostructures that can manipulate light at the nanoscale. Metalenses offer tremendous potential for miniaturizing optical systems, but they are not without their own challenges, particularly when it comes to capturing full-color images without distortions.

In a recent study published in Advanced Photonics, researchers have introduced an innovative, deep-learning-powered, end-to-end metalens imaging system that overcomes many of these limitations. This system pairs a mass-produced metalens with a specialized image restoration framework driven by deep learning.

By combining advanced optical hardware with artificial intelligence (AI), the team has achieved high-resolution, aberration-free, full-color images, all while maintaining the compact form factor that metalenses promise.

The metalens itself is fabricated using nanoimprint lithography, a scalable and cost-effective method, followed by atomic layer deposition, allowing for large-scale production of these lenses. The metalens is designed to focus light efficiently but, like most metalenses, suffers from chromatic aberration and other distortions due to its interaction with light of different wavelengths.

(a) Ground truth images, (b) metalens images, and (c) images reconstructed by our model. The images are affiliated with the test set data. The central (red) and outer (yellow) regions of the images are enlarged to access the restoration of the metalens image at high and low viewing angle, respectively. The outer regions of the metalens images (yellow box) are successfully restored, even though those are more severely degraded than the inner region (red box) due to the angular aberration under high viewing angle. Credit: Advanced Photonics (2024). DOI: 10.1117/1.AP.6.6.066002

To address this, the deep learning model is trained to recognize and correct the color distortions and blurring caused by the metalens. This approach is unique because it learns from a large dataset of images and applies these corrections to future images captured by the system.

The image restoration framework uses adversarial learning, where two neural networks are trained together. One network generates corrected images, and the other assesses their quality, pushing the system to improve continuously.

Additionally, advanced techniques like positional embedding help the model understand how image distortions change depending on the viewing angle. This results in significant improvements in the restored images, particularly in terms of color accuracy and sharpness across the entire field of view.

The system produces images that rival those from traditional, bulky lenses, but in a much smaller, more efficient package. This innovation has the potential to revolutionize a wide range of industries, from consumer electronics like smartphones and cameras to more specialized applications in VR and AR. By solving the core issues of metalenses—chromatic and angular aberrations—this work brings us closer to integrating these compact lenses into everyday imaging devices.

According to senior and corresponding author Junsuk Rho, Mu-Eun-Jae endowed chair professor with a joint appointment in mechanical engineering, chemical engineering, and electrical engineering at Pohang University of Science and Technology (POSTECH, Korea), "This deep-learning-driven system marks a significant advancement in the field of optics, offering a new pathway to creating smaller, more efficient imaging systems without sacrificing quality."

The ability to mass-produce high-performance metalenses, combined with AI-powered corrections, brings us closer to a future where compact, lightweight, and high-quality imaging systems become the norm in both commercial and industrial applications.

More information: Joonhyuk Seo et al, Deep-learning-driven end-to-end metalens imaging, Advanced Photonics (2024). DOI: 10.1117/1.AP.6.6.066002

Journal information: Advanced Photonics

Provided by SPIE