Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation

Abstract

Segmentation of Prostate Cancer (PCa) tissues from Gleason graded histopathology images is vital for accurate diagnosis. Although deep learning (DL) based segmentation methods achieve state-of-the-art accuracy, they rely on large datasets with manual annotations. We propose a method to synthesize for PCa histopathology images by learning the geometrical relationship between different disease labels using self-supervised learning. We use a weakly supervised segmentation approach that uses Gleason score to segment the diseased regions and the resulting segmentation map is used to train a Shape Restoration Network (ShaRe-Net) to predict missing mask segments in a self-supervised manner. Using DenseUNet as the backbone generator architecture we incorporate latent variable sampling to inject diversity in the image generation process and thus improve robustness. Experiments on multiple histopathology datasets demonstrate the superiority of our method over competing image synthesis methods for segmentation tasks. Ablation studies show the benefits of integrating geometry and diversity in generating high-quality images, and our self-supervised approach with limited class-labeled data achieves similar performance as fully supervised learning.

arXiv commentarXiv admin note: text overlap with arXiv:2106.10230

References in corpus (21)

• A Simple Framework for Contrastive Learning of Visual Representations
• Generative Adversarial Network in Medical Imaging: A Review
• Data Augmentation Generative Adversarial Networks
• Development and Validation of a Deep Learning Algorithm for Improving Gleason Scoring of Prostate Cancer
• Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-task Learning
• Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology
• Retinal Vasculature Segmentation Using Local Saliency Maps and Generative Adversarial Networks For Image Super Resolution
• Semi-Supervised Histology Classification using Deep Multiple Instance Learning and Contrastive Predictive Coding
• Night Time Haze and Glow Removal using Deep Dilated Convolutional Network
• Chest X-rays Classification: A Multi-Label and Fine-Grained Problem
• Progressive Generative Adversarial Networks for Medical Image Super resolution
• GAN Based Medical Image Registration
• Improving Medical Image Classification with Label Noise Using Dual-uncertainty Estimation
• Towards Unsupervised Cancer Subtyping: Predicting Prognosis Using A Histologic Visual Dictionary
• Registration of Histopathogy Images Using Structural Information From Fine Grained Feature Maps
• Consensus Based Medical Image Segmentation Using Semi-Supervised Learning And Graph Cuts
• sZoom: A Framework for Automatic Zoom into High Resolution Surveillance Videos
• Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learning
• Multi-scale Deep Learning Architecture for Nucleus Detection in Renal Cell Carcinoma Microscopy Image
• Generative Adversarial Networks And Domain Adaptation For Training Data Independent Image Registration
• CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysis