Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Abstract

Histological analysis of tissue samples is one of the most widely used methods for disease diagnosis. After taking a sample from a patient, it goes through a lengthy and laborious preparation, which stains the tissue to visualize different histological features under a microscope. Here, we demonstrate a label-free approach to create a virtually-stained microscopic image using a single wide-field auto-fluorescence image of an unlabeled tissue sample, bypassing the standard histochemical staining process, saving time and cost. This method is based on deep learning, and uses a convolutional neural network trained using a generative adversarial network model to transform an auto-fluorescence image of an unlabeled tissue section into an image that is equivalent to the bright-field image of the stained-version of the same sample. We validated this method by successfully creating virtually-stained microscopic images of human tissue samples, including sections of salivary gland, thyroid, kidney, liver and lung tissue, also covering three different stains. This label-free virtual-staining method eliminates cumbersome and costly histochemical staining procedures, and would significantly simplify tissue preparation in pathology and histology fields.

References in corpus (4)

• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Deep Learning Microscopy
• Detecting Cancer Metastases on Gigapixel Pathology Images
• Deep learning enhanced mobile-phone microscopy

Cited by in corpus (53)

• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Deep Learning-enabled Virtual Histological Staining of Biological Samples
• Deep learning-based transformation of the H&E stain into special stains
• Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks
• Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• Phase Imaging with Computational Specificity (PICS) for measuring dry mass changes in sub-cellular compartments
• Misalignment Resilient Diffractive Optical Networks
• Cross-modality deep learning brings bright-field microscopy contrast to holography
• Self-supervised learning of hologram reconstruction using physics consistency
• High Accuracy Tumor Diagnoses and Benchmarking of Hematoxylin and Eosin Stained Prostate Core Biopsy Images Generated by Explainable Deep Neural Networks
• Single-shot autofocusing of microscopy images using deep learning
• Deep learning in biomedical optics
• Scale-, shift- and rotation-invariant diffractive optical networks
• Label-free virtual HER2 immunohistochemical staining of breast tissue using deep learning
• Virtual histological staining of unlabeled autopsy tissue
• Deep learning-based color holographic microscopy
• Label-free colorectal cancer screening using deep learning and spatial light interference microscopy (SLIM)
• Deep learning-enabled multiplexed point-of-care sensor using a paper-based fluorescence vertical flow assay
• Virtual stain transfer in histology via cascaded deep neural networks
• Digital staining in optical microscopy using deep learning -- a review
• Recurrent neural network-based volumetric fluorescence microscopy
• Fully Automatic Electrocardiogram Classification System based on Generative Adversarial Network with Auxiliary Classifier
• Extracting quantitative biological information from brightfield cell images using deep learning
• Quantitative particle agglutination assay for point-of-care testing using mobile holographic imaging and deep learning
• Deep Learning Cell Imaging through Anderson Localizing Optical Fibre
• Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks
• Pixel super-resolved virtual staining of label-free tissue using diffusion models
• Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learning
• Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study
• Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Network
• Virtual Gram staining of label-free bacteria using darkfield microscopy and deep learning
• A robust and scalable framework for hallucination detection in virtual tissue staining and digital pathology
• Computational interference microscopy enabled by deep learning
• Domain Adaptation-based Augmentation for Weakly Supervised Nuclei Detection
• Virtual Staining of Label-Free Tissue in Imaging Mass Spectrometry
• Automated Whole Slide Imaging for Label-Free Histology using Photon Absorption Remote Sensing Microscopy
• Virtual organelle self-coding for fluorescence imaging via adversarial learning
• Synthetic aperture interference light (SAIL) microscopy for high-throughput label-free imaging
• High-throughput fast full-color digital pathology based on Fourier ptychographic microscopy via color transfer
• Optimising image capture for low-light widefield quantitative fluorescence microscopy
• Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems
• Multiscale assay of unlabeled neurite dynamics using phase imaging with computational specificity (PICS)
• MIPHEI-ViT: Multiplex Immunofluorescence Prediction from H&E Images using ViT Foundation Models
• Label-free evaluation of lung and heart transplant biopsies using tissue autofluorescence-based virtual staining
• Global Pixel Transformers for Virtual Staining of Microscopy Images
• Detecting immune cells with label-free two-photon autofluorescence and deep learning
• Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks
• Deep Learning for Estimating Synaptic Health of Primary Neuronal Cell Culture
• Learning with minimal effort: leveraging in silico labeling for cell and nucleus segmentation
• Spatial light interference microscopy (SLIM): principle and applications to biomedicine
• Pixel Super-Resolved Fluorescence Lifetime Imaging Using Deep Learning
• Eigen component analysis: A quantum theory incorporated machine learning technique to find linearly maximum separable components