Non-invasive real-time imaging through scattering layers and around corners via speckle correlations
arXiv:1403.3316 · doi:10.1038/nphoton.2014.189
Abstract
Imaging with optical resolution through and inside complex samples is a difficult challenge with important applications in many fields. The fundamental problem is that inhomogeneous samples, such as biological tissues, randomly scatter and diffuse light, impeding conventional image formation. Despite many advancements, no current method enables to noninvasively image in real-time using diffused light. Here, we show that owing to the memory-effect for speckle correlations, a single image of the scattered light, captured with a standard high-resolution camera, encodes all the information that is required to image through the medium or around a corner. We experimentally demonstrate single-shot imaging through scattering media and around corners using incoherent light and various samples, from white paint to dynamic biological samples. Our lensless technique is simple, does not require laser sources, wavefront-shaping, nor time-gated detection, and is realized here using a camera-phone. It has the potential to enable imaging in currently inaccessible scenarios.
References in corpus (2)
Cited by in corpus (103)
- Light fields in complex media: mesoscopic scattering meets wave control
- Recent advances in wavefront shaping techniques for biomedical applications
- Non-line-of-sight Imaging
- Roadmap on Wavefront Shaping and deep imaging in complex media
- Characterization of the angular memory effect of scattered light in biological tissues
- Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
- Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy
- Exploiting speckle correlations to improve the resolution of wide-field fluorescence microscopy
- Controlling light propagation in multimode fibers for imaging, spectroscopy and beyond
- Phase Retrieval: From Computational Imaging to Machine Learning
- Large field-of-view non-invasive imaging through scattering layers using fluctuating random illumination
- Large-scale phase retrieval
- Learning-based real-time method to looking through scattering medium beyond the memory effect
- Non-line-of-sight imaging with picosecond temporal resolution
- Non-line-of-sight 3D imaging with a single-pixel camera
- All-optical image classification through unknown random diffusers using a single-pixel diffractive network
- Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision
- Scattering invariant modes of light in complex media
- Spatio-temporal wavefront shaping in a microwave cavity
- Tracking moving objects through scattering media via speckle correlations
- Recent Advances in Imaging Around Corners
- Imaging through a thin scattering layer and jointly retrieving the point-spread-function using phase-diversity
- Incoherent Diffractive Imaging via Intensity Correlations of hard X-rays
- Noninvasive linear fluorescence imaging through scattering media via wavefront shaping
- Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network
- Non-invasive single-shot recovery of point-spread function of a memory effect based scattering imaging system
- Exploit imaging through opaque wall via deep learning
- Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
- Imaging through scattering media via spatial-temporal encoded pattern illumination
- Customizing the angular memory effect for scattering media
- Imaging through glass diffusers using densely connected convolutional networks
- Single-step transmission matrix retrieval for fast imaging through multi-mode fibers
- Coherent enhancement of optical remission in diffusive media
- Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding
- Incoherent mode division multiplexing for high-security information encryption
- Recognizing three-dimensional phase images with deep learning
- Molecular Quantum Wakes for Clearing Fog
- Complementary Speckle Patterns : deterministic interchange of intrinsic vortices and maxima through Scattering Media
- Functional imaging through scattering medium via fluorescence speckle demixing and localization
- Deconvolved Image Restoration from Autocorrelations
- Non-invasive color imaging through scattering medium under broadband illumination
- Extrapolated speckle-correlation imaging
- Imaging trapped ion structures via fluorescence cross-correlation detection
- A Distortion Matrix Framework for High-Resolution Passive Seismic 3-D Imaging: Application to the San Jacinto Fault Zone, California
- Deep penetration fluorescence imaging through dense yeast cells suspensions using Airy beams
- Polarized hyperspectral imaging with single fiber bundle via incoherent light transmission matrix approach
- Deep learning-assisted imaging through stationary scattering media
- Real-time full-field imaging through scattering media by all-optical feedback
- Symmetry constraints for vector scattering and transfer matrices containing evanescent components: energy conservation, reciprocity and time reversal
- Passive Non-Line-of-Sight Imaging with Light Transport Modulation
- Speckle-correlation imaging through a kaleidoscopic multimode fiber
- Aperiodic photonics of elliptic curves
- Spatial coherence of light inside three dimensional media
- Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera
- Spatial sub-Rayleigh imaging analysis via speckle laser illumination
- Topological winding guaranteed coherent orthogonal scattering
- HoloGen: An open source toolbox for high-speed hologram generation
- Random matrix theory of polarized light scattering in disordered media
- Role of Multiple Scattering in Single Particle Perturbations in Absorbing Random Media
- Model-free estimation of the Cramér-Rao bound for deep-learning microscopy in complex media
- Recovering the spectral and spatial information of an object behind a scattering media
- Ultrasound differential phase contrast using backscattering and the memory effect
- Partial Coherence in modern optics: Emil Wolf's legacy in the 21st century
- Sensorless wavefront correction in two-photon microscopy across different turbidity scales
- A needle-based deep-neural-network camera
- Event-enhanced Passive Non-line-of-sight imaging for moving objects with Physical embedding
- DaISy: Diffuser-aided Sub-THz Imaging System
- TFPnP: Tuning-free Plug-and-Play Proximal Algorithm with Applications to Inverse Imaging Problems
- Controlled light scattering of a single nanoparticle by wavefront shaping
- Scattered Image Reconstruction at Near-infrared Based on Spatial Modulation Instability
- Direct Object Recognition Without Line-of-Sight Using Optical Coherence
- Characterizing quantum gases in time-controlled disorder realizations using cross-correlations of density distributions
- ISP-Agnostic Image Reconstruction for Under-Display Cameras
- Imaging at depth in tissue with a single-pixel camera
- Simultaneously improving multiple imaging parameters with scattering media
- Reciprocity-assisted ghost imaging through dynamic random media
- Correlating light fields through disordered media across multiple degrees of freedom
- Transfer Learning in General Lensless Imaging through Scattering Media
- SLM aided noninvasive imaging through thin scattering layers
- Uncertainty Relations for Mesoscopic Coherent Light
- Automatic Differentiation for All Photons Imaging to See Inside Volumetric Scattering Media
- Ab Initio Spatial Phase Retrieval via Intensity Triple Correlations
- Automatic calibration of time of flight based non-line-of-sight reconstruction
- Speckle-based X-ray microtomography via preconditioned Wirtinger flow
- Digital-twin imaging based on descattering Gaussian splatting
- Modeling Deep Learning Based Privacy Attacks on Physical Mail
- Imaging Hidden Objects with Consumer LiDAR via Motion Induced Sampling
- Generalized image deconvolution by exploiting spatially variant point spread functions
- Imaging-free object recognition enabled by optical coherence
- Sub-Nyquist sampling boosts targeted light transport through opaque scattering media
- Full field-of-view multi-targets imaging through scattering beyond 3D optical memory effect
- Diffuse Optical Ptychography
- Quantitative Dynamic Phase Mapping via Single-Arm Field-Correlation Ghost Imaging
- Complementary Fourier single-pixel imaging
- Optimization of retina-like illumination patterns in ghost imaging
- Measurement of two-point coherence functions of electromagnetic optical fields and applications of optical coherence
- Covariance spectroscopy of molecular gases using fs pulse bursts created by modulational instability in gas-filled hollow-core fiber
- Phasor field waves: A statistical treatment for the case of a partially coherent optical carrier
- Non-invasive super-resolution imaging through scattering media using fluctuating speckles
- Light propagation in Extreme Conditions - The role of optically clear tissues and scattering layers in optical biomedical imaging
- Learning-based super interpolation and extrapolation for speckled image reconstruction
- 3D Object Imaging through Scattering Media
- Tailoring propagation of light via spin-orbit interactions in correlated disorder