All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Abstract

Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 88.53%. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.

28 Pages, 6 Figures

References in corpus (18)

• Non-invasive real-time imaging through scattering layers and around corners via speckle correlations
• Image Transmission Through an Opaque Material
• Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks
• Terahertz Pulse Shaping Using Diffractive Surfaces
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• Misalignment Resilient Diffractive Optical Networks
• Ensemble learning of diffractive optical networks
• Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network
• Diffractive all-optical computing for quantitative phase imaging
• Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network
• To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
• Cascadable all-optical NAND gates using diffractive networks
• Adaptive 3D descattering with a dynamic synthesis network
• Classification and reconstruction of spatially overlapping phase images using diffractive optical networks
• Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers
• Computer-free, all-optical reconstruction of holograms using diffractive networks
• All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfaces

Cited by in corpus (4)

• Pyramid diffractive optical networks for unidirectional image magnification and demagnification
• Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network
• Transferable polychromatic optical encoder for neural networks
• Model-free estimation of the Cramér-Rao bound for deep-learning microscopy in complex media