Intelligent Meta-Imagers: From Compressed to Learned Sensing

Abstract

Computational meta-imagers synergize metamaterial hardware with advanced signal processing approaches such as compressed sensing. Recent advances in artificial intelligence (AI) are gradually reshaping the landscape of meta-imaging. Most recent works use AI for data analysis, but some also use it to program the physical meta-hardware. The role of "intelligence" in the measurement process and its implications for critical metrics like latency are often not immediately clear. Here, we comprehensively review the evolution of computational meta-imaging from the earliest frequency-diverse compressive systems to modern programmable intelligent meta-imagers. We introduce a clear taxonomy in terms of the flow of task-relevant information that has direct links to information theory: compressive meta-imagers indiscriminately acquire all scene information in a task-agnostic measurement process that aims at a near-isometric embedding; intelligent meta-imagers highlight task-relevant information in a task-aware measurement process that is purposefully non-isometric. The measurement process of intelligent meta-imagers is thus simultaneously an analog wave processor that implements a first task-specific inference step "over-the-air". We provide explicit design tutorials for the integration of programmable meta-atoms as trainable physical weights into an intelligent end-to-end sensing pipeline. This merging of the physical world of metamaterial engineering and the digital world of AI enables the remarkable latency gains of intelligent meta-imagers. We further outline emerging opportunities for cognitive meta-imagers with reverberation-enhanced resolution and we point out how the meta-imaging community can reap recent advances in the vibrant field of metamaterial wave processors to reach the holy grail of low-energy ultra-fast all-analog intelligent meta-sensors.

63 pages including 9 figures

References in corpus (60)

• Adam: A Method for Stochastic Optimization
• Deep Learning with Coherent Nanophotonic Circuits
• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Wide-field, high-resolution Fourier ptychographic microscopy
• Compressed Sensing of Block-Sparse Signals: Uncertainty Relations and Efficient Recovery
• Universal Linear Optics
• Compressive ghost imaging
• Recurrent Models of Visual Attention
• Task-Driven Dictionary Learning
• Ghost imaging with a single detector
• Light fields in complex media: mesoscopic scattering meets wave control
• Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media
• Self-Configuring Universal Linear Optical Component
• DeepNIS: Deep Neural Network for Nonlinear Electromagnetic Inverse Scattering
• Global optimization of dielectric metasurfaces using a physics-driven neural network
• Learning to see through multimode fibers
• Wave Physics as an Analog Recurrent Neural Network
• DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium
• High-sensitivity optical monitoring of a micro-mechanical resonator with a quantum-limited optomechanical sensor
• Resonant Metalenses for Breaking the Diffraction Barrier
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks
• Low Photon Count Phase Retrieval Using Deep Learning
• Reconfigurable Intelligent Surfaces for Rich Scattering Wireless Communications: Recent Experiments, Challenges, and Opportunities
• All-Optical Information Processing Capacity of Diffractive Surfaces
• Compressive adaptive computational ghost imaging
• Ensemble learning of diffractive optical networks
• Artificial Neural Network with Physical Dynamic Metasurface Layer for Optimal Sensing
• Optimal Communication Channels in a Disordered World with Tamed Randomness
• Experimental Synthetic Aperture Radar with Dynamic Metasurfaces
• Meta-Programmable Analog Differentiator
• Single-Frequency Microwave Imaging with Dynamic Metasurface Apertures
• Deeply Sub-Wavelength Localization with Reverberation-Coded-Aperture
• Maximum information states for coherent scattering measurements
• RF Chain Reduction for MIMO Systems: A Hardware Prototype
• Computational polarimetric microwave imaging
• Performance Analysis and Dynamic Evolution of Deep Convolutional Neural Network for Nonlinear Inverse Scattering
• Leveraging Chaos for Wave-Based Analog Computation: Demonstration with Indoor Wireless Communication Signals
• LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers
• Using Machine-Learning to Optimize phase contrast in a Low-Cost Cellphone Microscope
• Convolutional neural networks that teach microscopes how to image
• Far-field subwavelength acoustic imaging by deep learning
• Phaseless computational imaging with a radiating metasurface
• Optimized Analog Information Multiplexing Across Custom-Tailored MetaCavity Configurations
• Robust Position Sensing with Wave Fingerprints in Dynamic Complex Environments
• 3D imaging from multipath temporal echoes
• Learning Sensor Multiplexing Design through Back-propagation
• Wave-based extreme deep learning based on non-linear time-Floquet entanglement
• Subwavelength position sensing using nonlinear feedback and wave chaos
• Analytical Modeling of a Two-Dimensional Waveguide-Fed Metasurface
• Optimal Physical Preprocessing for Example-Based Super-Resolution
• Multi-element microscope optimization by a learned sensing network with composite physical layers
• Optimal control of coherent light scattering for binary decision problems
• Image reconstruction through a multimode fiber with a simple neural network architecture
• Implementing Non-Universal Features with a Random Matrix Theory Approach: Application to Space-to-Configuration Multiplexing
• Invariance property of the Fisher information in scattering media
• Learning beamforming in ultrasound imaging
• Computational Ghost Imaging
• Scattering-coded elastic meta-boundary

Cited by in corpus (7)

• Intelligent metaphotonics empowered by machine learning
• Meta-Programmable Analog Differentiator
• XR-RF Imaging Enabled by Software-Defined Metasurfaces and Machine Learning: Foundational Vision, Technologies and Challenges
• Self-Adaptive RISs Beyond Free Space: Convergence of Localization, Sensing and Communication under Rich-Scattering Conditions
• Noise-Adaptive Intelligent Programmable Meta-Imager
• A self-adaptive RIS that estimates and shapes fading rich-scattering wireless channels
• Granger Causality for Compressively Sensed Sparse Signals