Single-shot autofocusing of microscopy images using deep learning

Abstract

We demonstrate a deep learning-based offline autofocusing method, termed Deep-R, that is trained to rapidly and blindly autofocus a single-shot microscopy image of a specimen that is acquired at an arbitrary out-of-focus plane. We illustrate the efficacy of Deep-R using various tissue sections that were imaged using fluorescence and brightfield microscopy modalities and demonstrate snapshot autofocusing under different scenarios, such as a uniform axial defocus as well as a sample tilt within the field-of-view. Our results reveal that Deep-R is significantly faster when compared with standard online algorithmic autofocusing methods. This deep learning-based blind autofocusing framework opens up new opportunities for rapid microscopic imaging of large sample areas, also reducing the photon dose on the sample.

arXiv comment27 pages, 8 figures, 9 supplementary figures, 2 supplementary tables

References in corpus (9)

• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• Deep Learning Microscopy
• Deep-STORM: super-resolution single-molecule microscopy by deep learning
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery
• Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning
• Rapid focus map surveying for whole slide imaging with continues sample motion
• Semi-Blind Spatially-Variant Deconvolution in Optical Microscopy with Local Point Spread Function Estimation By Use Of Convolutional Neural Networks

Cited by in corpus (10)

• Self-supervised learning of hologram reconstruction using physics consistency
• Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning
• Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
• Recurrent neural network-based volumetric fluorescence microscopy
• Semi-supervised machine learning model for analysis of nanowire morphologies from transmission electron microscopy images
• Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks
• Deep learning-based virtual refocusing of images using an engineered point-spread function
• Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data
• Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems
• An Affordable Fiducial Marker Strategy for Reliable Autofocus in Long-Term Live Microscopy