Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks

Abstract

Manual counting of mitotic tumor cells in tissue sections constitutes one of the strongest prognostic markers for breast cancer. This procedure, however, is time-consuming and error-prone. We developed a method to automatically detect mitotic figures in breast cancer tissue sections based on convolutional neural networks (CNNs). Application of CNNs to hematoxylin and eosin (H&E) stained histological tissue sections is hampered by: (1) noisy and expensive reference standards established by pathologists, (2) lack of generalization due to staining variation across laboratories, and (3) high computational requirements needed to process gigapixel whole-slide images (WSIs). In this paper, we present a method to train and evaluate CNNs to specifically solve these issues in the context of mitosis detection in breast cancer WSIs. First, by combining image analysis of mitotic activity in phosphohistone-H3 (PHH3) restained slides and registration, we built a reference standard for mitosis detection in entire H&E WSIs requiring minimal manual annotation effort. Second, we designed a data augmentation strategy that creates diverse and realistic H&E stain variations by modifying the hematoxylin and eosin color channels directly. Using it during training combined with network ensembling resulted in a stain invariant mitosis detector. Third, we applied knowledge distillation to reduce the computational requirements of the mitosis detection ensemble with a negligible loss of performance. The system was trained in a single-center cohort and evaluated in an independent multicenter cohort from The Cancer Genome Atlas on the three tasks of the Tumor Proliferation Assessment Challenge (TUPAC). We obtained a performance within the top-3 best methods for most of the tasks of the challenge.

Accepted to appear in IEEE Transactions on Medical Imaging

References in corpus (2)

• A Survey on Deep Learning in Medical Image Analysis
• Assessment of algorithms for mitosis detection in breast cancer histopathology images

Cited by in corpus (22)

• Deep neural network models for computational histopathology: A survey
• Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology
• Artificial Intelligence for Digital and Computational Pathology
• Breast cancer detection using artificial intelligence techniques: A systematic literature review
• Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
• WILDS: A Benchmark of in-the-Wild Distribution Shifts
• Neural Image Compression for Gigapixel Histopathology Image Analysis
• NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentation
• StainNet: a fast and robust stain normalization network
• AdvMIL: Adversarial Multiple Instance Learning for the Survival Analysis on Whole-Slide Images
• RandStainNA: Learning Stain-Agnostic Features from Histology Slides by Bridging Stain Augmentation and Normalization
• Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System
• Are pathologist-defined labels reproducible? Comparison of the TUPAC16 mitotic figure dataset with an alternative set of labels
• Objective Diagnosis for Histopathological Images Based on Machine Learning Techniques: Classical Approaches and New Trends
• Comparison of Consecutive and Re-stained Sections for Image Registration in Histopathology
• OMG-Net: A Deep Learning Framework Deploying Segment Anything to Detect Pan-Cancer Mitotic Figures from Haematoxylin and Eosin-Stained Slides
• How Many Annotators Do We Need? -- A Study on the Influence of Inter-Observer Variability on the Reliability of Automatic Mitotic Figure Assessment
• Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification
• On the Value of PHH3 for Mitotic Figure Detection on H&E-stained Images
• A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers
• Radial Prediction Domain Adaption Classifier for the MIDOG 2022 Challenge
• A Semi-Supervised Framework for Automatic Pixel-Wise Breast Cancer Grading of Histological Images