Snapshot Multispectral Imaging Using a Diffractive Optical Network

Abstract

Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 times the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially-repeating virtual spectral filter array with 2x2=4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

24 Pages, 9 Figures

References in corpus (6)

• Misalignment Resilient Diffractive Optical Networks
• Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network
• Diffractive all-optical computing for quantitative phase imaging
• Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network
• To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
• All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfaces

Cited by in corpus (10)

• All-optical image denoising using a diffractive visual processor
• Data class-specific all-optical transformations and encryption
• Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor
• Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network
• Pyramid diffractive optical networks for unidirectional image magnification and demagnification
• All-Optical Phase Conjugation Using Diffractive Wavefront Processing
• Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network
• Integration of Programmable Diffraction with Digital Neural Networks
• Optoelectronic generative adversarial networks
• Broadband Unidirectional Visible Imaging Using Wafer-Scale Nano-Fabrication of Multi-Layer Diffractive Optical Processors