Deep Learning Microscopy

Abstract

We demonstrate that a deep neural network can significantly improve optical microscopy, enhancing its spatial resolution over a large field-of-view and depth-of-field. After its training, the only input to this network is an image acquired using a regular optical microscope, without any changes to its design. We blindly tested this deep learning approach using various tissue samples that are imaged with low-resolution and wide-field systems, where the network rapidly outputs an image with remarkably better resolution, matching the performance of higher numerical aperture lenses, also significantly surpassing their limited field-of-view and depth-of-field. These results are transformative for various fields that use microscopy tools, including e.g., life sciences, where optical microscopy is considered as one of the most widely used and deployed techniques. Beyond such applications, our presented approach is broadly applicable to other imaging modalities, also spanning different parts of the electromagnetic spectrum, and can be used to design computational imagers that get better and better as they continue to image specimen and establish new transformations among different modes of imaging.

References in corpus (4)

• Deep Learning in Neural Networks: An Overview
• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
• Deep Bilateral Learning for Real-Time Image Enhancement

Cited by in corpus (13)

• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Misalignment Resilient Diffractive Optical Networks
• Plasmonic colours predicted by deep learning
• Does deep learning always outperform simple linear regression in optical imaging?
• On the interplay between physical and content priors in deep learning for computational imaging
• Machine learning reveals complex behaviours in optically trapped particles
• Imaging through glass diffusers using densely connected convolutional networks
• Autofocusing technologies for whole slide imaging and automated microscopy
• Learning an optimal PSF-pair for ultra-dense 3D localization microscopy
• A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems
• Deep learning-based phase control method for coherent beam combining and its application in generating orbital angular momentum beams
• Deep learning based high-resolution incoherent x-ray imaging with a single-pixel detector
• Quantifying the effect of image compression on supervised learning applications in optical microscopy