Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology

Abstract

In the field of computational pathology, the use of decision support systems powered by state-of-the-art deep learning solutions has been hampered by the lack of large labeled datasets. Until recently, studies relied on datasets in the order of few hundreds of slides which are not enough to train a model that can work at scale in the clinic. Here, we have gathered a dataset consisting of 12,160 slides, two orders of magnitude larger than previous datasets in pathology and equivalent to 25 times the pixel count of the entire ImageNet dataset. Given the size of our dataset it is possible for us to train a deep learning model under the Multiple Instance Learning (MIL) assumption where only the overall slide diagnosis is necessary for training, avoiding all the expensive pixel-wise annotations that are usually part of supervised learning approaches. We test our framework on a complex task, that of prostate cancer diagnosis on needle biopsies. We performed a thorough evaluation of the performance of our MIL pipeline under several conditions achieving an AUC of 0.98 on a held-out test set of 1,824 slides. These results open the way for training accurate diagnosis prediction models at scale, laying the foundation for decision support system deployment in the clinic.

References in corpus (2)

• Detecting Cancer Metastases on Gigapixel Pathology Images
• Computational Pathology: Challenges and Promises for Tissue Analysis

Cited by in corpus (15)

• Deep neural network models for computational histopathology: A survey
• Deep Learning for Whole Slide Image Analysis: An Overview
• PanNuke Dataset Extension, Insights and Baselines
• An attention-based multi-resolution model for prostate whole slide imageclassification and localization
• Self-Supervised Similarity Learning for Digital Pathology
• Pathologist-Level Grading of Prostate Biopsies with Artificial Intelligence
• Towards computational fluorescence microscopy: Machine learning-based integrated prediction of morphological and molecular tumor profiles
• Improving Prostate Cancer Detection with Breast Histopathology Images
• Towards Unsupervised Cancer Subtyping: Predicting Prognosis Using A Histologic Visual Dictionary
• Segmenting Potentially Cancerous Areas in Prostate Biopsies using Semi-Automatically Annotated Data
• A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers
• Kernel Self-Attention in Deep Multiple Instance Learning
• Weakly supervised training of pixel resolution segmentation models on whole slide images
• Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation
• Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learning