Neural Nano-Optics for High-quality Thin Lens Imaging

Abstract

Nano-optic imagers that modulate light at sub-wavelength scales could unlock unprecedented applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In this work, we close this performance gap by presenting the first neural nano-optics. We devise a fully differentiable learning method that learns a metasurface physical structure in conjunction with a novel, neural feature-based image reconstruction algorithm. Experimentally validating the proposed method, we achieve an order of magnitude lower reconstruction error. As such, we present the first high-quality, nano-optic imager that combines the widest field of view for full-color metasurface operation while simultaneously achieving the largest demonstrated 0.5 mm, f/2 aperture.

References in corpus (1)

• Multiwavelength Achromatic Metasurfaces by Dispersive Phase Compensation

Cited by in corpus (14)

• Inverse design enables large-scale high-performance meta-optics reshaping virtual reality
• Nonlocal Flat Optics
• Intelligent metaphotonics empowered by machine learning
• Inverse design of photonic devices with strict foundry fabrication constraints
• End-to-end metasurface inverse design for single-shot multi-channel imaging
• Inverse Designed Extended Depth of Focus Meta-Optics for Broadband Imaging in the Visible
• End-to-End Optimization of Metasurfaces for Imaging with Compressed Sensing
• Unrolled Primal-Dual Networks for Lensless Cameras
• Diffractive optical system design by cascaded propagation
• Noise-Adaptive Intelligent Programmable Meta-Imager
• Multifunctional acoustic holography based on compact acoustic geometric-phase meta-array
• A centimeter-scale achromatic hybrid metalens with polarization-insensitivity in the visible
• Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography
• Hybrid Diffractive Optics Design via Hardware-in-the-Loop Methodology for Achromatic Extended-Depth-of-Field Imaging