Deep learning enhanced mobile-phone microscopy

Abstract

Mobile-phones have facilitated the creation of field-portable, cost-effective imaging and sensing technologies that approach laboratory-grade instrument performance. However, the optical imaging interfaces of mobile-phones are not designed for microscopy and produce spatial and spectral distortions in imaging microscopic specimens. Here, we report on the use of deep learning to correct such distortions introduced by mobile-phone-based microscopes, facilitating the production of high-resolution, denoised and colour-corrected images, matching the performance of benchtop microscopes with high-end objective lenses, also extending their limited depth-of-field. After training a convolutional neural network, we successfully imaged various samples, including blood smears, histopathology tissue sections, and parasites, where the recorded images were highly compressed to ease storage and transmission for telemedicine applications. This method is applicable to other low-cost, aberrated imaging systems, and could offer alternatives for costly and bulky microscopes, while also providing a framework for standardization of optical images for clinical and biomedical applications.

References in corpus (3)

• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Deep Learning Microscopy

Cited by in corpus (32)

• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• Deep learning in nano-photonics: inverse design and beyond
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Deep Learning-enabled Virtual Histological Staining of Biological Samples
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning
• Terahertz Pulse Shaping Using Diffractive Surfaces
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• Resolution enhancement in scanning electron microscopy using deep learning
• Pushing the limits of optical information storage using deep learning
• Deep learning-based super-resolution in coherent imaging systems
• Real-time coherent diffraction inversion using deep generative networks
• Automated screening of sickle cells using a smartphone-based microscope and deep learning
• Review: Deep Learning in Electron Microscopy
• Self-supervised learning of hologram reconstruction using physics consistency
• Deep learning enables high-throughput analysis of particle-aggregation-based bio-sensors imaged using holography
• Deep learning-based holographic polarization microscopy
• Quantitative particle agglutination assay for point-of-care testing using mobile holographic imaging and deep learning
• Spatial images from temporal data
• Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks
• Pixel super-resolved virtual staining of label-free tissue using diffusion models
• Optimal Physical Preprocessing for Example-Based Super-Resolution
• Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data
• Deep learning for nano-photonic materials -- The solution to everything!?
• Identification of particle mixtures using machine-learning-assisted laser diffraction analysis
• Deep learning Framework for Mobile Microscopy
• Label-free evaluation of lung and heart transplant biopsies using tissue autofluorescence-based virtual staining
• Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks
• BlurryScope enables compact, cost-effective scanning microscopy for HER2 scoring using deep learning on blurry images
• Spectral splitting and concentration of broadband light using neural networks