Deep learning in biomedical optics

Abstract

This article reviews deep learning applications in biomedical optics with a particular emphasis on image formation. The review is organized by imaging domains within biomedical optics and includes microscopy, fluorescence lifetime imaging, in vivo microscopy, widefield endoscopy, optical coherence tomography, photoacoustic imaging, diffuse tomography, and functional optical brain imaging. For each of these domains, we summarize how deep learning has been applied and highlight methods by which deep learning can enable new capabilities for optics in medicine. Challenges and opportunities to improve translation and adoption of deep learning in biomedical optics are also summarized.

References in corpus (51)

• Adam: A Method for Stochastic Optimization
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Survey on Deep Learning in Medical Image Analysis
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• A survey of cross-validation procedures for model selection
• Image reconstruction by domain transform manifold learning
• Noise2Noise: Learning Image Restoration without Clean Data
• Learned Primal-dual Reconstruction
• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• Deep Learning Microscopy
• Deep-STORM: super-resolution single-molecule microscopy by deep learning
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• Automatic Classification of Cancerous Tissue in Laserendomicroscopy Images of the Oral Cavity using Deep Learning
• DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
• Deep learning approach to Fourier ptychographic microscopy
• Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning
• Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
• Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation
• Reliable deep-learning-based phase imaging with uncertainty quantification
• Resolving challenges in deep learning-based analyses of histopathological images using explanation methods
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• Phase Imaging with Computational Specificity (PICS) for measuring dry mass changes in sub-cellular compartments
• Deep Learning in Photoacoustic Tomography: Current approaches and future directions
• A deep learning framework for quality assessment and restoration in video endoscopy
• Deep learning-based super-resolution in coherent imaging systems
• Deep Learning Diffuse Optical Tomography
• HoloStain: Holographic virtual staining of individual biological cells
• Limited View and Sparse Photoacoustic Tomography for Neuroimaging with Deep Learning
• High Accuracy Tumor Diagnoses and Benchmarking of Hematoxylin and Eosin Stained Prostate Core Biopsy Images Generated by Explainable Deep Neural Networks
• Computationally Efficient Deep Neural Network for Computed Tomography Image Reconstruction
• Adversarial training with cycle consistency for unsupervised super-resolution in endomicroscopy
• A Partially Learned Algorithm for Joint Photoacoustic Reconstruction and Segmentation
• SIMBA: Scalable Inversion in Optical Tomography using Deep Denoising Priors
• Label-free colorectal cancer screening using deep learning and spatial light interference microscopy (SLIM)
• Machine learning for faster and smarter fluorescence lifetime imaging microscopy
• Deep Transfer Learning Methods for Colon Cancer Classification in Confocal Laser Microscopy Images
• Deep Learning with Cinematic Rendering: Fine-Tuning Deep Neural Networks Using Photorealistic Medical Images
• Rethinking Monocular Depth Estimation with Adversarial Training
• Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
• DeepLSR: a deep learning approach for laser speckle reduction
• Improving colonoscopy lesion classification using semi-supervised deep learning
• SLAM Endoscopy enhanced by adversarial depth prediction
• Speckle illumination SFDI for projector-free optical property mapping
• Noise2Void - Learning Denoising from Single Noisy Images
• An end-to-end (deep) neural network applied to raw EEG, fNIRs and body motion data for data fusion and BCI classification task without any pre-/post-processing
• Learning from Irregularly Sampled Data for Endomicroscopy Super-resolution: A Comparative Study of Sparse and Dense Approaches
• Data-Driven Design for Fourier Ptychographic Microscopy
• Accurate Stress Assessment based on functional Near Infrared Spectroscopy using Deep Learning Approach
• Segmentation of Cellular Patterns in Confocal Images of Melanocytic Lesions in vivo via a Multiscale Encoder-Decoder Network (MED-Net)
• Explainable Anatomical Shape Analysis through Deep Hierarchical Generative Models

Cited by in corpus (6)

• Quantum machine learning for image classification
• Deep Learning in fNIRS: A review
• Harnessing Artificial Intelligence To Reduce Phototoxicity in Live Imaging
• Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data
• Integration of Programmable Diffraction with Digital Neural Networks
• Model-free estimation of the Cramér-Rao bound for deep-learning microscopy in complex media