Deep learning-based transformation of the H&E stain into special stains

Abstract

Pathology is practiced by visual inspection of histochemically stained slides. Most commonly, the hematoxylin and eosin (H&E) stain is used in the diagnostic workflow and it is the gold standard for cancer diagnosis. However, in many cases, especially for non-neoplastic diseases, additional "special stains" are used to provide different levels of contrast and color to tissue components and allow pathologists to get a clearer diagnostic picture. In this study, we demonstrate the utility of supervised learning-based computational stain transformation from H&E to different special stains (Masson's Trichrome, periodic acid-Schiff and Jones silver stain) using tissue sections from kidney needle core biopsies. Based on evaluation by three renal pathologists, followed by adjudication by a fourth renal pathologist, we show that the generation of virtual special stains from existing H&E images improves the diagnosis in several non-neoplastic kidney diseases sampled from 58 unique subjects. A second study performed by three pathologists found that the quality of the special stains generated by the stain transformation network was statistically equivalent to those generated through standard histochemical staining. As the transformation of H&E images into special stains can be achieved within 1 min or less per patient core specimen slide, this stain-to-stain transformation framework can improve the quality of the preliminary diagnosis when additional special stains are needed, along with significant savings in time and cost, reducing the burden on healthcare system and patients.

arXiv comment27 Pages, 6 Figures

References in corpus (6)

• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Distribution Matching Losses Can Hallucinate Features in Medical Image Translation
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• High Accuracy Tumor Diagnoses and Benchmarking of Hematoxylin and Eosin Stained Prostate Core Biopsy Images Generated by Explainable Deep Neural Networks
• DASGAN -- Joint Domain Adaptation and Segmentation for the Analysis of Epithelial Regions in Histopathology PD-L1 Images

Cited by in corpus (15)

• Deep Learning-enabled Virtual Histological Staining of Biological Samples
• Self-supervised learning of hologram reconstruction using physics consistency
• Label-free virtual HER2 immunohistochemical staining of breast tissue using deep learning
• Virtual histological staining of unlabeled autopsy tissue
• Virtual stain transfer in histology via cascaded deep neural networks
• Digital staining in optical microscopy using deep learning -- a review
• Pixel super-resolved virtual staining of label-free tissue using diffusion models
• Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learning
• The ACROBAT 2022 Challenge: Automatic Registration Of Breast Cancer Tissue
• Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Network
• A robust and scalable framework for hallucination detection in virtual tissue staining and digital pathology
• Analysis and Validation of Image Search Engines in Histopathology
• Experts' cognition-driven ensemble deep learning for external validation of predicting pathological complete response to neoadjuvant chemotherapy from histological images in breast cancer
• Label-free evaluation of lung and heart transplant biopsies using tissue autofluorescence-based virtual staining
• Morphomics via Next-generation Electron Microscopy