Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model

Abstract

Training deep neural networks usually requires a large amount of labeled data to obtain good performance. However, in medical image analysis, obtaining high-quality labels for the data is laborious and expensive, as accurately annotating medical images demands expertise knowledge of the clinicians. In this paper, we present a novel relation-driven semi-supervised framework for medical image classification. It is a consistency-based method which exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations, and leverages a self-ensembling model to produce high-quality consistency targets for the unlabeled data. Considering that human diagnosis often refers to previous analogous cases to make reliable decisions, we introduce a novel sample relation consistency (SRC) paradigm to effectively exploit unlabeled data by modeling the relationship information among different samples. Superior to existing consistency-based methods which simply enforce consistency of individual predictions, our framework explicitly enforces the consistency of semantic relation among different samples under perturbations, encouraging the model to explore extra semantic information from unlabeled data. We have conducted extensive experiments to evaluate our method on two public benchmark medical image classification datasets, i.e.,skin lesion diagnosis with ISIC 2018 challenge and thorax disease classification with ChestX-ray14. Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.

IEEE Transactions on Medical Imaging, 2020

References in corpus (5)

• MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Data
• Semi-Supervised Deep Learning for Fully Convolutional Networks
• Weakly Supervised Deep Learning for Thoracic Disease Classification and Localization on Chest X-rays
• Factorised spatial representation learning: application in semi-supervised myocardial segmentation
• Deep semi-supervised segmentation with weight-averaged consistency targets

Cited by in corpus (11)

• Recent advances and clinical applications of deep learning in medical image analysis
• A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
• Self-supervised driven consistency training for annotation efficient histopathology image analysis
• AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation
• Learning Inductive Attention Guidance for Partially Supervised Pancreatic Ductal Adenocarcinoma Prediction
• External Attention Assisted Multi-Phase Splenic Vascular Injury Segmentation with Limited Data
• Semi-supervised classification of radiology images with NoTeacher: A Teacher that is not Mean
• Medical Instrument Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning
• Class-Specific Distribution Alignment for Semi-Supervised Medical Image Classification
• Exponential Pixelating Integral transform with dual fractal features for enhanced chest X-ray abnormality detection
• A Multi-Scale Framework for Out-of-Distribution Detection in Dermoscopic Images