Deep learning-based virtual refocusing of images using an engineered point-spread function

Abstract

We present a virtual image refocusing method over an extended depth of field (DOF) enabled by cascaded neural networks and a double-helix point-spread function (DH-PSF). This network model, referred to as W-Net, is composed of two cascaded generator and discriminator network pairs. The first generator network learns to virtually refocus an input image onto a user-defined plane, while the second generator learns to perform a cross-modality image transformation, improving the lateral resolution of the output image. Using this W-Net model with DH-PSF engineering, we extend the DOF of a fluorescence microscope by ~20-fold. This approach can be applied to develop deep learning-enabled image reconstruction methods for localization microscopy techniques that utilize engineered PSFs to improve their imaging performance, including spatial resolution and volumetric imaging throughput.

arXiv comment7 Pages, 3 Figures, 1 Table

References in corpus (8)

• Deep Learning Microscopy
• Whole-brain calcium imaging with cellular resolution in freely behaving C. elegans
• Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted light
• DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
• Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery
• Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning
• Single-shot autofocusing of microscopy images using deep learning
• Recurrent neural network-based volumetric fluorescence microscopy

Cited by in corpus (5)

• Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
• Virtual stain transfer in histology via cascaded deep neural networks
• Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks
• Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Network
• Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data