Pyramid diffractive optical networks for unidirectional image magnification and demagnification

Abstract

Diffractive deep neural networks (D2NNs) are composed of successive transmissive layers optimized using supervised deep learning to all-optically implement various computational tasks between an input and output field-of-view (FOV). Here, we present a pyramid-structured diffractive optical network design (which we term P-D2NN), optimized specifically for unidirectional image magnification and demagnification. In this design, the diffractive layers are pyramidally scaled in alignment with the direction of the image magnification or demagnification. This P-D2NN design creates high-fidelity magnified or demagnified images in only one direction, while inhibiting the image formation in the opposite direction - achieving the desired unidirectional imaging operation using a much smaller number of diffractive degrees of freedom within the optical processor volume. Furthermore, P-D2NN design maintains its unidirectional image magnification/demagnification functionality across a large band of illumination wavelengths despite being trained with a single wavelength. We also designed a wavelength-multiplexed P-D2NN, where a unidirectional magnifier and a unidirectional demagnifier operate simultaneously in opposite directions, at two distinct illumination wavelengths. Furthermore, we demonstrate that by cascading multiple unidirectional P-D2NN modules, we can achieve higher magnification factors. The efficacy of the P-D2NN architecture was also validated experimentally using terahertz illumination, successfully matching our numerical simulations. P-D2NN offers a physics-inspired strategy for designing task-specific visual processors.

41 Pages, 11 Figures

References in corpus (21)

• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Parallel convolution processing using an integrated photonic tensor core
• Universal Linear Optics
• Intelligent Computing: The Latest Advances, Challenges and Future
• Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy
• Ensemble learning of diffractive optical networks
• Snapshot Multispectral Imaging Using a Diffractive Optical Network
• Diffractive all-optical computing for quantitative phase imaging
• Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network
• To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
• All-optical image classification through unknown random diffusers using a single-pixel diffractive network
• Universal Linear Intensity Transformations Using Spatially-Incoherent Diffractive Processors
• Reconfigurable nonreciprocity with nonlinear Fano diode
• Data class-specific all-optical transformations and encryption
• Unidirectional Imaging using Deep Learning-Designed Materials
• Universal Polarization Transformations: Spatial programming of polarization scattering matrices using a deep learning-designed diffractive polarization transformer
• Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network
• Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network

Cited by in corpus (3)

• Integration of Programmable Diffraction with Digital Neural Networks
• Broadband Unidirectional Visible Imaging Using Wafer-Scale Nano-Fabrication of Multi-Layer Diffractive Optical Processors
• Unidirectional imaging with partially coherent light