Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network

Abstract

We report deep learning-based design of a massively parallel broadband diffractive neural network for all-optically performing a large group of arbitrarily-selected, complex-valued linear transformations between an input and output field-of-view, each with N_i and N_o pixels, respectively. This broadband diffractive processor is composed of N_w wavelength channels, each of which is uniquely assigned to a distinct target transformation. A large set of arbitrarily-selected linear transformations can be individually performed through the same diffractive network at different illumination wavelengths, either simultaneously or sequentially (wavelength scanning). We demonstrate that such a broadband diffractive network, regardless of its material dispersion, can successfully approximate N_w unique complex-valued linear transforms with a negligible error when the number of diffractive neurons (N) in its design matches or exceeds 2 x N_w x N_i x N_o. We further report that the spectral multiplexing capability (N_w) can be increased by increasing N; our numerical analyses confirm these conclusions for N_w > 180, which can be further increased to e.g., ~2000 depending on the upper bound of the approximation error. Massively parallel, wavelength-multiplexed diffractive networks will be useful for designing high-throughput intelligent machine vision systems and hyperspectral processors that can perform statistical inference and analyze objects/scenes with unique spectral properties.

arXiv comment30 Pages, 9 Figures

References in corpus (38)

• Adam: A Method for Stochastic Optimization
• Decoupled Weight Decay Regularization
• Deep Learning with Coherent Nanophotonic Circuits
• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Parallel convolution processing using an integrated photonic tensor core
• Photonics for artificial intelligence and neuromorphic computing
• 11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks
• Training deep neural networks for the inverse design of nanophotonic structures
• Universal Linear Optics
• A Generative Model for Inverse Design of Metamaterials
• Neuromorphic Silicon Photonic Networks
• Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems
• Single-chip photonic deep neural network for instantaneous image classification
• Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit
• All Optical Neural Network with Nonlinear Activation Functions
• Reinforcement Learning in a large scale photonic Recurrent Neural Network
• Freeform Diffractive Metagrating Design Based on Generative Adversarial Networks
• Wave Physics as an Analog Recurrent Neural Network
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks
• Scalable Optical Learning Operator
• Photonic tensor cores for machine learning
• Terahertz Pulse Shaping Using Diffractive Surfaces
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy
• All-Optical Information Processing Capacity of Diffractive Surfaces
• Misalignment Resilient Diffractive Optical Networks
• Ensemble learning of diffractive optical networks
• Optical Reservoir Computing using multiple light scattering for chaotic systems prediction
• Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network
• Diffractive all-optical computing for quantitative phase imaging
• To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
• Scale-, shift- and rotation-invariant diffractive optical networks
• Super-resolution image display using diffractive decoders
• Cascadable all-optical NAND gates using diffractive networks
• Classification and reconstruction of spatially overlapping phase images using diffractive optical networks
• All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfaces

Cited by in corpus (17)

• Snapshot Multispectral Imaging Using a Diffractive Optical Network
• Rapid Sensing of Hidden Objects and Defects using a Single-Pixel Diffractive Terahertz Processor
• All-optical image classification through unknown random diffusers using a single-pixel diffractive network
• Super-resolution image display using diffractive decoders
• All-optical image denoising using a diffractive visual processor
• Unidirectional Imaging using Deep Learning-Designed Materials
• Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor
• Learning Diffractive Optical Communication Around Arbitrary Opaque Occlusions
• Pyramid diffractive optical networks for unidirectional image magnification and demagnification
• Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks
• All-Optical Phase Conjugation Using Diffractive Wavefront Processing
• Integration of Programmable Diffraction with Digital Neural Networks
• Optoelectronic generative adversarial networks
• Universal point spread function engineering for 3D optical information processing
• Broadband Unidirectional Visible Imaging Using Wafer-Scale Nano-Fabrication of Multi-Layer Diffractive Optical Processors
• Optimizing Structured Surfaces for Diffractive Waveguides
• Phase-multiplexed optical computing: Reconfiguring a multi-task diffractive optical processor using illumination phase diversity