Phase recovery and holographic image reconstruction using deep learning in neural networks

Abstract

Phase recovery from intensity-only measurements forms the heart of coherent imaging techniques and holography. Here we demonstrate that a neural network can learn to perform phase recovery and holographic image reconstruction after appropriate training. This deep learning-based approach provides an entirely new framework to conduct holographic imaging by rapidly eliminating twin-image and self-interference related spatial artifacts. Compared to existing approaches, this neural network based method is significantly faster to compute, and reconstructs improved phase and amplitude images of the objects using only one hologram, i.e., requires less number of measurements in addition to being computationally faster. We validated this method by reconstructing phase and amplitude images of various samples, including blood and Pap smears, and tissue sections. These results are broadly applicable to any phase recovery problem, and highlight that through machine learning challenging problems in imaging science can be overcome, providing new avenues to design powerful computational imaging systems.

References in corpus (11)

• Deep Learning in Neural Networks: An Overview
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Wide-field, high-resolution Fourier ptychographic microscopy
• Deep Learning Microscopy
• A unified evaluation of iterative projection algorithms for phase retrieval
• Relaxed Averaged Alternating Reflections for Diffraction Imaging
• Solution to the twin image problem in holography
• Sparsity-based single-shot sub-wavelength coherent diffractive imaging
• Quantitative Imaging of Single, Unstained Viruses with Coherent X-rays
• Ultrafast, ultrabright, X-ray holography using a uniformly-redundant array
• Oversampling smoothness (OSS): an effective algorithm for phase retrieval of noisy diffraction intensities

Cited by in corpus (146)

• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• Deep Learning Microscopy
• Deep Learning in Medical Image Registration: A Survey
• Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media
• Deep learning in nano-photonics: inverse design and beyond
• Fringe pattern analysis using deep learning
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
• Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery
• Intelligent Nanophotonics: Merging Photonics and Artificial Intelligence at the Nanoscale
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Deep learning meets nanophotonics: A generalized accurate predictor for near fields and far fields of arbitrary 3D nanostructures
• Deep learning approach to Fourier ptychographic microscopy
• On the use of deep learning for phase recovery
• Hyperspectral terahertz microscopy via nonlinear ghost imaging
• Low Photon Count Phase Retrieval Using Deep Learning
• Reliable deep-learning-based phase imaging with uncertainty quantification
• Terahertz Pulse Shaping Using Diffractive Surfaces
• Deep learning enhanced mobile-phone microscopy
• Misalignment Resilient Diffractive Optical Networks
• High-speed in vitro intensity diffraction tomography
• Cross-modality deep learning brings bright-field microscopy contrast to holography
• Deep learning-based super-resolution in coherent imaging systems
• Optical coherent dot-product chip for sophisticated deep learning regression
• Real-time coherent diffraction inversion using deep generative networks
• Phase Retrieval: From Computational Imaging to Machine Learning
• Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization
• Review: Deep Learning in Electron Microscopy
• Self-supervised learning of hologram reconstruction using physics consistency
• The Numerics of Phase Retrieval
• Large-scale phase retrieval
• Diffractive all-optical computing for quantitative phase imaging
• Machine Learning Holography for 3D Particle Field Imaging
• Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networks
• PhaseGAN: A deep-learning phase-retrieval approach for unpaired datasets
• Single-shot autofocusing of microscopy images using deep learning
• Dual Polarization Full-Field Signal Waveform Reconstruction Using Intensity Only Measurements for Coherent Communications
• Deep learning enabled design of complex transmission matrices for universal optical components
• Optical Fringe Patterns Filtering Based on Multi-Stage Convolution Neural Network
• Deep learning enables high-throughput analysis of particle-aggregation-based bio-sensors imaged using holography
• High-Resolution Limited-Angle Phase Tomography of Dense Layered Objects Using Deep Neural Networks
• Near-field Fourier ptychography: super-resolution phase retrieval via speckle illumination
• Deep DIH : Statistically Inferred Reconstruction of Digital In-Line Holography by Deep Learning
• Deep learning approach to coherent noise reduction in optical diffraction tomography
• Deep learning-based holographic polarization microscopy
• Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy
• Does deep learning always outperform simple linear regression in optical imaging?
• Data class-specific all-optical transformations and encryption
• Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor
• Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning
• Multi-scale Convolutional Neural Networks for Inverse Problems
• Deep learning-based color holographic microscopy
• Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning
• Deep Iterative Reconstruction for Phase Retrieval
• A Two-step-training Deep Learning Framework for Real-time Computational Imaging without Physics Priors
• All-optical complex field imaging using diffractive processors
• Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
• Single-shot x-ray speckle-based imaging of a single-material object
• Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging
• Recurrent neural network-based volumetric fluorescence microscopy
• Adaptive 3D descattering with a dynamic synthesis network
• On the interplay between physical and content priors in deep learning for computational imaging
• Deep learning enabled strategies for modelling of complex aperiodic plasmonic metasurfaces of arbitrary size
• Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network
• Physics-driven universal twin-image removal network for digital in-line holographic microscopy
• Ghost imaging based on Y-net: a dynamic coding and conjugate-decoding approach
• Deep learning phase recovery: data-driven, physics-driven, or combining both?
• Deep Hybrid Scattering Image Learning
• Spatial images from temporal data
• Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network
• Exascale Deep Learning for Scientific Inverse Problems
• Spectral pre-modulation of training examples enhances the spatial resolution of the Phase Extraction Neural Network (PhENN)
• Dynamic imaging and characterization of volatile aerosols in e-cigarette emissions using deep learning-based holographic microscopy
• Machine learning identifies scale-free properties in disordered materials
• High space-bandwidth in quantitative phase imaging using partially spatially coherent optical coherence microscopy and deep neural network
• Limited-angle tomographic reconstruction of dense layered objects by dynamical machine learning
• Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Network
• Imaging through glass diffusers using densely connected convolutional networks
• eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imaging
• Robust Compressive Phase Retrieval via Deep Generative Priors
• Virtual impactor-based label-free bio-aerosol detection using holography and deep learning
• Calibration-free quantitative phase imaging using data-driven aberration modeling
• Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding
• prDeep: Robust Phase Retrieval with a Flexible Deep Network
• Propagation based phase retrieval of simulated intensity measurements using artificial neural networks
• Ultrafast Radiographic Imaging and Tracking: An overview of instruments, methods, data, and applications
• High-resolution label-free imaging of tissue morphology with confocal phase microscopy
• Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projection
• High-throughput screening of encapsulated islets using wide-field lens-free on-chip imaging
• SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network
• Learning to synthesize: splitting and recombining low and high spatial frequencies for image recovery
• Toward a Thinking Microscope: Deep Learning in Optical Microscopy and Image Reconstruction
• Characterization of exhaled e-cigarette aerosols in a vape shop using a field-portable holographic on-chip microscope
• FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imaging
• Accurate color imaging of pathology slides using holography and absorbance spectrum estimation of histochemical stains
• EM based Framework for Single-shot Compressive Holography
• Weak-lensing Mass Reconstruction of Galaxy Clusters with Convolutional Neural Network
• Phase retrieval with physics informed zero-shot learning
• Robust X-ray Sparse-view Phase Tomography via Hierarchical Synthesis Convolutional Neural Networks
• Convolutional neural network-based regression for depth prediction in digital holography
• Fourier Phase Retrieval with Extended Support Estimation via Deep Neural Network
• Deep Neural Networks for Computational Optical Form Measurements
• Phase Retrieval with Holography and Untrained Priors: Tackling the Challenges of Low-Photon Nanoscale Imaging
• Variational Inference for Computational Imaging Inverse Problems
• Nano-Resolution Visual Identifiers Enable Secure Monitoring in Next-Generation Cyber-Physical Systems
• Blind deblurring for microscopic pathology images using deep learning networks
• Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples
• Learning an optimal PSF-pair for ultra-dense 3D localization microscopy
• PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy
• A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems
• Deep-learning-based optical image hiding
• Deep neural networks for efficient phase demodulation in wavelength shifting interferometry
• Inverse scattering for reflection intensity phase microscopy
• Compression of phase-only holograms with JPEG standard and deep learning
• Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram
• Localization of nanoscale objects with light singularities
• Using Convex Optimization of Autocorrelation with Constrained Support and Windowing for Improved Phase Retrieval Accuracy
• Full-Field, Carrier-Less, Polarization-Diversity, Direct Detection Receiver based on Phase Retrieval
• Single-shot structured illumination microscopy
• Lensless in-line holographic microscopy with light source of low spatio-temporal coherence
• Computer-free, all-optical reconstruction of holograms using diffractive networks
• Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation
• Learning Illumination Patterns for Coded Diffraction Phase Retrieval
• Phase Retrieval using Expectation Consistent Signal Recovery Algorithm based on Hypernetwork
• Performance evaluation of an integrated photonic convolutional neural network based on delay buffering and wavelength division multiplexing
• Lensless multicore-fiber microendoscope for real-time tailored light field generation with phase encoder neural network (CoreNet)
• Temporal phase unwrapping using deep learning
• 3D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imaging
• Digital phase-only holography using deep conditional generative models
• Mode-Multiplexed Full-Field Reconstruction Using Direct and Phase Retrieval Detection
• Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Network
• Optical deep learning nano-profilometry
• X-ray ghost tomography: denoising, dose fractionation and mask considerations
• Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks
• Deep Phase Shifter for Quantitative Phase Imaging
• Resolving Complex Subwavelength Grating Structures Using Topologically Structured Light
• Physics-based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imaging
• Comprehensive deep learning model for optical holography
• Uncertainty quantification for ptychography using normalizing flows
• Gabor-Type Holography Solved Analytically for Complex-valued Phase Disks
• Experimental digital Gabor hologram rendering by a model-trained convolutional neural network
• Numerical study of laser micro- and nano-processing of nanocomposite porous materials
• Machine learning for prediction of extreme statistics in modulation instability
• Fast Autofocusing using Tiny Transformer Networks for Digital Holographic Microscopy
• Machine learning holography for measuring 3D particle size distribution