Self-supervised driven consistency training for annotation efficient histopathology image analysis

Abstract

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer variability. While recent self-supervised and semi-supervised methods can alleviate this need by learn-ing unsupervised feature representations, they still struggle to generalize well to downstream tasks when the number of labeled instances is small. In this work, we overcome this challenge by leveraging both task-agnostic and task-specific unlabeled data based on two novel strategies: i) a self-supervised pretext task that harnesses the underlying multi-resolution contextual cues in histology whole-slide images to learn a powerful supervisory signal for unsupervised representation learning; ii) a new teacher-student semi-supervised consistency paradigm that learns to effectively transfer the pretrained representations to downstream tasks based on prediction consistency with the task-specific un-labeled data. We carry out extensive validation experiments on three histopathology benchmark datasets across two classification and one regression-based tasks, i.e., tumor metastasis detection, tissue type classification, and tumor cellularity quantification. Under limited-label data, the proposed method yields tangible improvements, which is close or even outperforming other state-of-the-art self-supervised and supervised baselines. Furthermore, we empirically show that the idea of bootstrapping the self-supervised pretrained features is an effective way to improve the task-specific semi-supervised learning on standard benchmarks. Code and pretrained models will be made available at: https://github.com/srinidhiPY/SSL_CR_Histo

References in corpus (7)

• A Survey on Deep Learning in Medical Image Analysis
• Deep neural network models for computational histopathology: A survey
• Automated Gleason Grading of Prostate Biopsies using Deep Learning
• Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology
• Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model
• Deep learning-based survival prediction for multiple cancer types using histopathology images
• Neural Image Compression for Gigapixel Histopathology Image Analysis

Cited by in corpus (12)

• From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathology
• Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis
• A Review of Predictive and Contrastive Self-supervised Learning for Medical Images
• Nuclei Segmentation with Point Annotations from Pathology Images via Self-Supervised Learning and Co-Training
• FMDNN: A Fuzzy-guided Multi-granular Deep Neural Network for Histopathological Image Classification
• A Dual-branch Self-supervised Representation Learning Framework for Tumour Segmentation in Whole Slide Images
• A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models
• GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation
• Pan-cancer Histopathology WSI Pre-training with Position-aware Masked Autoencoder
• Self-Supervised Representation Learning for Nerve Fiber Distribution Patterns in 3D-PLI
• Renal Cell Carcinoma subtyping: learning from multi-resolution localization
• INSITE: labelling medical images using submodular functions and semi-supervised data programming