Non-invasive real-time imaging through scattering layers and around corners via speckle correlations
arXiv:1403.3316 · doi:10.1038/nphoton.2014.189
Abstract
Imaging with optical resolution through and inside complex samples is a difficult challenge with important applications in many fields. The fundamental problem is that inhomogeneous samples, such as biological tissues, randomly scatter and diffuse light, impeding conventional image formation. Despite many advancements, no current method enables to noninvasively image in real-time using diffused light. Here, we show that owing to the memory-effect for speckle correlations, a single image of the scattered light, captured with a standard high-resolution camera, encodes all the information that is required to image through the medium or around a corner. We experimentally demonstrate single-shot imaging through scattering media and around corners using incoherent light and various samples, from white paint to dynamic biological samples. Our lensless technique is simple, does not require laser sources, wavefront-shaping, nor time-gated detection, and is realized here using a camera-phone. It has the potential to enable imaging in currently inaccessible scenarios.
References in corpus (10)
- Measuring the Transmission Matrix in Optics : An Approach to the Study and Control of Light Propagation in Disordered Media
- Exploiting disorder for perfect focusing
- Image Transmission Through an Opaque Material
- Focusing and Compression of Ultrashort Pulses through Scattering Media
- GESPAR: Efficient Phase Retrieval of Sparse Signals
- Controlling light in scattering media noninvasively using the photo-acoustic transmission-matrix
- Control of light transmission through opaque scattering media in space and time
- Imaging blood cells through scattering biological tissue using speckle scanning microscopy
- Noise in laser speckle correlation and imaging techniques
- Direct Determination of Diffusion Properties of Random Media from Speckle Contrast
Cited by in corpus (179)
- Light fields in complex media: mesoscopic scattering meets wave control
- Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media
- Complex wavefront engineering with disorder-engineered metasurfaces
- Recent advances in wavefront shaping techniques for biomedical applications
- Non-line-of-sight Imaging
- Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium
- Translation correlations in anisotropically scattering media
- Single-shot multispectral imaging with a monochromatic camera
- Smart optical coherence tomography for ultra-deep imaging through highly scattering media
- Roadmap on Wavefront Shaping and deep imaging in complex media
- Characterization of the angular memory effect of scattered light in biological tissues
- Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
- Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy
- Non-invasive focusing and imaging in scattering media with a fluorescence-based transmission matrix
- Optically lightweight tracking of objects around a corner
- Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar
- Exploiting speckle correlations to improve the resolution of wide-field fluorescence microscopy
- Controlling light propagation in multimode fibers for imaging, spectroscopy and beyond
- Memory effect assisted imaging through multimode optical fibres
- Single-shot diffraction-limited imaging through scattering layers via bispectrum analysis
- Phase Retrieval: From Computational Imaging to Machine Learning
- Noninvasive super-resolution imaging through scattering media
- Computational time-of-flight diffuse optical tomography
- Large field-of-view non-invasive imaging through scattering layers using fluctuating random illumination
- Large-scale phase retrieval
- Learning-based real-time method to looking through scattering medium beyond the memory effect
- Single-Frequency Microwave Imaging with Dynamic Metasurface Apertures
- Non-line-of-sight imaging with picosecond temporal resolution
- Seeing through multimode fibers with real-valued intensity transmission matrices
- Single shot large field of view imaging with scattering media by spatial demultiplexing
- All-optical image classification through unknown random diffusers using a single-pixel diffractive network
- Non-line-of-sight 3D imaging with a single-pixel camera
- Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision
- The rotational memory effect of a multimode fiber
- Wide field fluorescence epi-microscopy behind a scattering medium enabled by speckle correlations
- Scattering invariant modes of light in complex media
- Hanbury Brown and Twiss Interferometry with Twisted Light
- Spatio-temporal wavefront shaping in a microwave cavity
- Imaging objects through scattering layers and around corners by retrieval of the scattered point spread function
- Wide-Field Multiphoton Imaging Through Scattering Media Without Correction
- Passive optical time-of-flight for Non line-of-sight localization
- Rapid Phase Retrieval by Lasing
- Imaging of objects through a thin scattering layer using a spectrally and spatially separated reference
- Readout of fluorescence functional signals through highly scattering tissue
- Non-invasive Focusing Through Scattering Layers Using Speckle-Correlations
- A Two-step-training Deep Learning Framework for Real-time Computational Imaging without Physics Priors
- Tracking moving objects through scattering media via speckle correlations
- Recent Advances in Imaging Around Corners
- Imaging through a thin scattering layer and jointly retrieving the point-spread-function using phase-diversity
- Displacement-agnostic coherent imaging through scatter with an interpretable deep neural network
- Single-shot non-invasive three-dimensional imaging through scattering media
- Incoherent Diffractive Imaging via Intensity Correlations of hard X-rays
- Enhanced nonlinear imaging through scattering media using transmission matrix based wavefront shaping
- Angular memory effect of transmission eigenchannels
- Depth-Resolved Speckle-Correlations Imaging through Scattering Layers
- Multi-modal Non-line-of-sight Passive Imaging
- Noninvasive linear fluorescence imaging through scattering media via wavefront shaping
- Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network
- Intensity correlations between reflected and transmitted speckle patterns
- Non-invasive single-shot recovery of point-spread function of a memory effect based scattering imaging system
- Color imaging through the scattering media based on phase retrieval with triple correlation
- Phase recovery from a Bayesian point of view: the variational approach
- Ghost imaging based on Y-net: a dynamic coding and conjugate-decoding approach
- Exploit imaging through opaque wall via deep learning
- Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition
- Single-shot thermal ghost imaging using wavelength-division multiplexing
- Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
- The dependent scattering effect on radiative properties of micro/nanoscale discrete disordered media
- Focusing large spectral bandwidths through scattering media
- Imaging through scattering media via spatial-temporal encoded pattern illumination
- Customizing the angular memory effect for scattering media
- High-resolution long-working-distance reference-free holographic microscopy exploiting speckle-correlation scattering matrix
- Correlations between reflected and transmitted intensity patterns emerging from opaque disordered media
- Imaging through glass diffusers using densely connected convolutional networks
- Enhancing security of optical cryptosystem with position-multiplexing and ultra-broadband illumination
- Robust Compressive Phase Retrieval via Deep Generative Priors
- Statistics and control of waves in disordered media
- Single-step transmission matrix retrieval for fast imaging through multi-mode fibers
- Mutual information between reflected and transmitted speckle images
- Coherent enhancement of optical remission in diffusive media
- Coherent control of light for non-line-of-sight imaging
- Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding
- Controlling the intensity of light in large areas at the interfaces of a scattering medium
- Incoherent mode division multiplexing for high-security information encryption
- prDeep: Robust Phase Retrieval with a Flexible Deep Network
- Recognizing three-dimensional phase images with deep learning
- Phase-Retrieved Tomography enables imaging of a Tumor Spheroid in Mesoscopy Regime
- Complementary Speckle Patterns : deterministic interchange of intrinsic vortices and maxima through Scattering Media
- Molecular Quantum Wakes for Clearing Fog
- Functional imaging through scattering medium via fluorescence speckle demixing and localization
- Compensation of Beer-Lambert attenuation using non-diffracting Bessel beams
- Holographic imaging through a scattering medium by diffuser-aided statistical averaging
- Hyperuniformity in amorphous speckle patterns
- Discrete Anderson Speckle
- Non-invasive color imaging through scattering medium under broadband illumination
- Extrapolated speckle-correlation imaging
- A Distortion Matrix Framework for High-Resolution Passive Seismic 3-D Imaging: Application to the San Jacinto Fault Zone, California
- Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problems
- Imaging trapped ion structures via fluorescence cross-correlation detection
- Coherent anti-Stokes Raman scattering through thick biological tissues by single wavefront shaping
- Deconvolved Image Restoration from Autocorrelations
- Polarized hyperspectral imaging with single fiber bundle via incoherent light transmission matrix approach
- Deep penetration fluorescence imaging through dense yeast cells suspensions using Airy beams
- Deep learning-assisted imaging through stationary scattering media
- Passive Non-Line-of-Sight Imaging with Light Transport Modulation
- Hybrid correlation holography with a single pixel detector
- Symmetry constraints for vector scattering and transfer matrices containing evanescent components: energy conservation, reciprocity and time reversal
- Universal bounds for imaging in scattering media
- An all-optical technique enables instantaneous single-shot demodulation of images at high frequency
- Real-time full-field imaging through scattering media by all-optical feedback
- Speckle-correlation imaging through a kaleidoscopic multimode fiber
- Intensity of waves inside a strongly disordered medium
- Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera
- Exponential Krylov time integration for modeling multi-frequency optical response with monochromatic sources
- Quantum correlation of light scattered by disordered media
- Spatial coherence of light inside three dimensional media
- Aperiodic photonics of elliptic curves
- Superbunching pseudothermal light with intensity modulated laser light and rotating groundglass
- Spatial sub-Rayleigh imaging analysis via speckle laser illumination
- Imaging around corners with single-pixel detector by computational ghost imaging
- Controlling optical memory effects in disordered media with coated metamaterials
- Lensless Wiener-Khinchin telescope based on high-order spatial autocorrelation of thermal light
- Topological winding guaranteed coherent orthogonal scattering
- Synthetic Wavelength Holography: An Extension of Gabor's Holographic Principle to Imaging with Scattered Wavefronts
- Steady-state Non-Line-of-Sight Imaging
- Role of Multiple Scattering in Single Particle Perturbations in Absorbing Random Media
- Virtual Wave Optics for Non-Line-of-Sight Imaging
- HoloGen: An open source toolbox for high-speed hologram generation
- Random matrix theory of polarized light scattering in disordered media
- Partial Coherence in modern optics: Emil Wolf's legacy in the 21st century
- Retrieval of non-sparse object through scattering media beyond the memory effect
- Model-free estimation of the Cramér-Rao bound for deep-learning microscopy in complex media
- Recovering the spectral and spatial information of an object behind a scattering media
- Ultrasound differential phase contrast using backscattering and the memory effect
- Event-enhanced Passive Non-line-of-sight imaging for moving objects with Physical embedding
- Controlling propagation of spatial coherence for enhanced imaging through scattering media
- A needle-based deep-neural-network camera
- Sensorless wavefront correction in two-photon microscopy across different turbidity scales
- Towards smart optical focusing: Deep learning-empowered wavefront shaping in nonstationary scattering media
- DaISy: Diffuser-aided Sub-THz Imaging System
- TFPnP: Tuning-free Plug-and-Play Proximal Algorithm with Applications to Inverse Imaging Problems
- Controlled light scattering of a single nanoparticle by wavefront shaping
- Imaging at depth in tissue with a single-pixel camera
- Scattered Image Reconstruction at Near-infrared Based on Spatial Modulation Instability
- Characterizing quantum gases in time-controlled disorder realizations using cross-correlations of density distributions
- ISP-Agnostic Image Reconstruction for Under-Display Cameras
- Direct Object Recognition Without Line-of-Sight Using Optical Coherence
- SLM aided noninvasive imaging through thin scattering layers
- Correlating light fields through disordered media across multiple degrees of freedom
- Reciprocity-assisted ghost imaging through dynamic random media
- Simultaneously improving multiple imaging parameters with scattering media
- Transfer Learning in General Lensless Imaging through Scattering Media
- Uncertainty Relations for Mesoscopic Coherent Light
- Automatic calibration of time of flight based non-line-of-sight reconstruction
- Generalized image deconvolution by exploiting spatially variant point spread functions
- Imaging Hidden Objects with Consumer LiDAR via Motion Induced Sampling
- Digital-twin imaging based on descattering Gaussian splatting
- Speckle-based X-ray microtomography via preconditioned Wirtinger flow
- Automatic Differentiation for All Photons Imaging to See Inside Volumetric Scattering Media
- Ab Initio Spatial Phase Retrieval via Intensity Triple Correlations
- Imaging-free object recognition enabled by optical coherence
- Single-shot optical imaging through scattering medium using digital in-line holography
- Widefield lensless endoscopy via speckle-correlations
- Modeling Deep Learning Based Privacy Attacks on Physical Mail
- 3D Object Imaging through Scattering Media
- Full field-of-view multi-targets imaging through scattering beyond 3D optical memory effect
- Measurement of two-point coherence functions of electromagnetic optical fields and applications of optical coherence
- Sub-Nyquist sampling boosts targeted light transport through opaque scattering media
- Complementary Fourier single-pixel imaging
- Scattering Assisted Imaging
- Tailoring propagation of light via spin-orbit interactions in correlated disorder
- Covariance spectroscopy of molecular gases using fs pulse bursts created by modulational instability in gas-filled hollow-core fiber
- Learning-based super interpolation and extrapolation for speckled image reconstruction
- Phasor field waves: A statistical treatment for the case of a partially coherent optical carrier
- Optimization of retina-like illumination patterns in ghost imaging
- Diffuse Optical Ptychography
- Light propagation in Extreme Conditions - The role of optically clear tissues and scattering layers in optical biomedical imaging
- Quantitative Dynamic Phase Mapping via Single-Arm Field-Correlation Ghost Imaging
- Non-invasive super-resolution imaging through scattering media using fluctuating speckles