Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
arXiv:1807.08284 · doi:10.1016/j.media.2019.02.012
Abstract
Tumor proliferation is an important biomarker indicative of the prognosis of breast cancer patients. Assessment of tumor proliferation in a clinical setting is highly subjective and labor-intensive task. Previous efforts to automate tumor proliferation assessment by image analysis only focused on mitosis detection in predefined tumor regions. However, in a real-world scenario, automatic mitosis detection should be performed in whole-slide images (WSIs) and an automatic method should be able to produce a tumor proliferation score given a WSI as input. To address this, we organized the TUmor Proliferation Assessment Challenge 2016 (TUPAC16) on prediction of tumor proliferation scores from WSIs. The challenge dataset consisted of 500 training and 321 testing breast cancer histopathology WSIs. In order to ensure fair and independent evaluation, only the ground truth for the training dataset was provided to the challenge participants. The first task of the challenge was to predict mitotic scores, i.e., to reproduce the manual method of assessing tumor proliferation by a pathologist. The second task was to predict the gene expression based PAM50 proliferation scores from the WSI. The best performing automatic method for the first task achieved a quadratic-weighted Cohen's kappa score of = 0.567, 95% CI [0.464, 0.671] between the predicted scores and the ground truth. For the second task, the predictions of the top method had a Spearman's correlation coefficient of r = 0.617, 95% CI [0.581 0.651] with the ground truth. This was the first study that investigated tumor proliferation assessment from WSIs. The achieved results are promising given the difficulty of the tasks and weakly-labelled nature of the ground truth. However, further research is needed to improve the practical utility of image analysis methods for this task.
arXiv commentOverview paper of the TUPAC16 challenge: http://tupac.tue-image.nl/
References in corpus (3)
Cited by in corpus (35)
- Deep neural network models for computational histopathology: A survey
- Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology
- Deep Learning for Whole Slide Image Analysis: An Overview
- Artificial Intelligence for Digital and Computational Pathology
- WILDS: A Benchmark of in-the-Wild Distribution Shifts
- Neural Image Compression for Gigapixel Histopathology Image Analysis
- A Comprehensive Review for Breast Histopathology Image Analysis Using Classical and Deep Neural Networks
- Mitosis domain generalization in histopathology images -- The MIDOG challenge
- Similar Image Search for Histopathology: SMILY
- NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentation
- Streaming convolutional neural networks for end-to-end learning with multi-megapixel images
- Deep learning algorithms out-perform veterinary pathologists in detecting the mitotically most active tumor region
- Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis
- A completely annotated whole slide image dataset of canine breast cancer to aid human breast cancer research
- Multi-task pre-training of deep neural networks for digital pathology
- Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
- Deep learning assessment of breast terminal duct lobular unit involution: towards automated prediction of breast cancer risk
- Survey of XAI in digital pathology
- Deep Learning-Based Grading of Ductal Carcinoma In Situ in Breast Histopathology Images
- Gigapixel Histopathological Image Analysis using Attention-based Neural Networks
- Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System
- Are pathologist-defined labels reproducible? Comparison of the TUPAC16 mitotic figure dataset with an alternative set of labels
- OMG-Net: A Deep Learning Framework Deploying Segment Anything to Detect Pan-Cancer Mitotic Figures from Haematoxylin and Eosin-Stained Slides
- How Many Annotators Do We Need? -- A Study on the Influence of Inter-Observer Variability on the Reliability of Automatic Mitotic Figure Assessment
- Histologic Dataset of Normal and Atypical Mitotic Figures on Human Breast Cancer (AMi-Br)
- One-Pixel Attack Deceives Computer-Assisted Diagnosis of Cancer
- Re-identification from histopathology images
- Orientation-Disentangled Unsupervised Representation Learning for Computational Pathology
- A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers
- A Petri Dish for Histopathology Image Analysis
- Challenging mitosis detection algorithms: Global labels allow centroid localization
- Renal Cell Carcinoma Detection and Subtyping with Minimal Point-Based Annotation in Whole-Slide Images
- Automated Scoring of Nuclear Pleomorphism Spectrum with Pathologist-level Performance in Breast Cancer
- Efficient Fine-Tuning of DINOv3 Pretrained on Natural Images for Atypical Mitotic Figure Classification
- Chromatic and spatial analysis of one-pixel attacks against an image classifier