Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers

Abstract

Imaging through diffusive media is a challenging problem, where the existing solutions heavily rely on digital computers to reconstruct distorted images. We provide a detailed analysis of a computer-free, all-optical imaging method for seeing through random, unknown phase diffusers using diffractive neural networks, covering different deep learning-based training strategies. By analyzing various diffractive networks designed to image through random diffusers with different correlation lengths, a trade-off between the image reconstruction fidelity and distortion reduction capability of the diffractive network was observed. During its training, random diffusers with a range of correlation lengths were used to improve the diffractive network's generalization performance. Increasing the number of random diffusers used in each epoch reduced the overfitting of the diffractive network's imaging performance to known diffusers. We also demonstrated that the use of additional diffractive layers improved the generalization capability to see through new, random diffusers. Finally, we introduced deliberate misalignments in training to 'vaccinate' the network against random layer-to-layer shifts that might arise due to the imperfect assembly of the diffractive networks. These analyses provide a comprehensive guide in designing diffractive networks to see through random diffusers, which might profoundly impact many fields, such as biomedical imaging, atmospheric physics, and autonomous driving.

arXiv comment42 Pages, 9 Figures

References in corpus (18)

• Adam: A Method for Stochastic Optimization
• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Measuring the Transmission Matrix in Optics : An Approach to the Study and Control of Light Propagation in Disordered Media
• Image Transmission Through an Opaque Material
• Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks
• Terahertz Pulse Shaping Using Diffractive Surfaces
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• All-Optical Information Processing Capacity of Diffractive Surfaces
• Misalignment Resilient Diffractive Optical Networks
• Ensemble learning of diffractive optical networks
• Diffractive all-optical computing for quantitative phase imaging
• Learning from synthetic photorealistic raindrop for single image raindrop removal
• Cascadable all-optical NAND gates using diffractive networks
• Deep Hybrid Scattering Image Learning
• Computer-free, all-optical reconstruction of holograms using diffractive networks

Cited by in corpus (4)

• All-optical image classification through unknown random diffusers using a single-pixel diffractive network
• Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network
• Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding
• Integration of Programmable Diffraction with Digital Neural Networks