Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis
arXiv:2208.08789 · doi:10.1088/1361-6560/ac910a
Abstract
Histopathological images contain abundant phenotypic information and pathological patterns, which are the gold standards for disease diagnosis and essential for the prediction of patient prognosis and treatment outcome. In recent years, computer-automated analysis techniques for histopathological images have been urgently required in clinical practice, and deep learning methods represented by convolutional neural networks have gradually become the mainstream in the field of digital pathology. However, obtaining large numbers of fine-grained annotated data in this field is a very expensive and difficult task, which hinders the further development of traditional supervised algorithms based on large numbers of annotated data. More recent studies have started to liberate from the traditional supervised paradigm, and the most representative ones are the studies on weakly supervised learning paradigm based on weak annotation, semi-supervised learning paradigm based on limited annotation, and self-supervised learning paradigm based on pathological image representation learning. These new methods have led a new wave of automatic pathological image diagnosis and analysis targeted at annotation efficiency. With a survey of over 130 papers, we present a comprehensive and systematic review of the latest studies on weakly supervised learning, semi-supervised learning, and self-supervised learning in the field of computational pathology from both technical and methodological perspectives. Finally, we present the key challenges and future trends for these techniques.
arXiv commentComprehensive survey for Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis (total of 212 references)
References in corpus (39)
- A Simple Framework for Contrastive Learning of Visual Representations
- Representation Learning with Contrastive Predictive Coding
- Bootstrap your own latent: A new approach to self-supervised Learning
- Improved Baselines with Momentum Contrastive Learning
- Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
- Unsupervised Data Augmentation for Consistency Training
- Unsupervised Representation Learning by Predicting Image Rotations
- Temporal Ensembling for Semi-Supervised Learning
- NIPS 2016 Tutorial: Generative Adversarial Networks
- Self-supervised Learning: Generative or Contrastive
- BEiT: BERT Pre-Training of Image Transformers
- Deep neural network models for computational histopathology: A survey
- Automated Gleason Grading of Prostate Biopsies using Deep Learning
- BACH: Grand Challenge on Breast Cancer Histology Images
- Attention-based Deep Multiple Instance Learning
- Semi-Supervised Learning with Generative Adversarial Networks
- Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networks
- Revisiting Multiple Instance Neural Networks
- Development and Validation of a Deep Learning Algorithm for Improving Gleason Scoring of Prostate Cancer
- TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification
- Classifying and Segmenting Microscopy Images Using Convolutional Multiple Instance Learning
- Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
- Billion-scale semi-supervised learning for image classification
- Models Genesis
- Self-supervised learning methods and applications in medical imaging analysis: A survey
- Neural Image Compression for Gigapixel Histopathology Image Analysis
- Good Semi-supervised Learning that Requires a Bad GAN
- Attention-Based Deep Neural Networks for Detection of Cancerous and Precancerous Esophagus Tissue on Histopathological Slides
- Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images
- Self-supervised driven consistency training for annotation efficient histopathology image analysis
- Deep Semi Supervised Generative Learning for Automated PD-L1 Tumor Cell Scoring on NSCLC Tissue Needle Biopsies
- Multiple instance learning with graph neural networks
- Cluster-to-Conquer: A Framework for End-to-End Multi-Instance Learning for Whole Slide Image Classification
- Self-Supervision Closes the Gap Between Weak and Strong Supervision in Histology
- Self-Supervised Nuclei Segmentation in Histopathological Images Using Attention
- Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology
- PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers
- Teacher-Student chain for efficient semi-supervised histology image classification
- Semi-Supervised Learning for Cancer Detection of Lymph Node Metastases