Coherence Awareness in Diffractive Neural Networks
arXiv:2408.06681 · doi:10.1002/lpor.202401299
Abstract
Diffractive neural networks hold great promise for applications requiring intensive computational processing. Considerable attention has focused on diffractive networks for either spatially coherent or spatially incoherent illumination. Here we illustrate that, as opposed to imaging systems, in diffractive networks the degree of spatial coherence has a dramatic effect. In particular, we show that when the spatial coherence length on the object is comparable to the minimal feature size preserved by the optical system, neither the incoherent nor the coherent extremes serve as acceptable approximations. Importantly, this situation is inherent to many settings involving active illumination, including reflected light microscopy, autonomous vehicles and smartphones. Following this observation, we propose a general framework for training diffractive networks for any specified degree of spatial and temporal coherence, supporting all types of linear and nonlinear layers. Using our method, we numerically optimize networks for image classification, and thoroughly investigate their performance dependence on the illumination coherence properties. We further introduce the concept of coherence-blind networks, which have enhanced resilience to changes in illumination conditions. Our findings serve as a steppingstone toward adopting all-optical neural networks in real-world applications, leveraging nothing but natural light.
Project's code https://github.com/matankleiner/Coherence-Awareness-in-Diffractive-Neural-Networks
References in corpus (9)
- Photonics for artificial intelligence and neuromorphic computing
- MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification
- The physics of optical computing
- Misalignment Resilient Diffractive Optical Networks
- Diffractive all-optical computing for quantitative phase imaging
- To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
- Universal Linear Intensity Transformations Using Spatially-Incoherent Diffractive Processors
- Data class-specific all-optical transformations and encryption
- Cascadable all-optical NAND gates using diffractive networks