Improving colonoscopy lesion classification using semi-supervised deep learning

Abstract

While data-driven approaches excel at many image analysis tasks, the performance of these approaches is often limited by a shortage of annotated data available for training. Recent work in semi-supervised learning has shown that meaningful representations of images can be obtained from training with large quantities of unlabeled data, and that these representations can improve the performance of supervised tasks. Here, we demonstrate that an unsupervised jigsaw learning task, in combination with supervised training, results in up to a 9.8% improvement in correctly classifying lesions in colonoscopy images when compared to a fully-supervised baseline. We additionally benchmark improvements in domain adaptation and out-of-distribution detection, and demonstrate that semi-supervised learning outperforms supervised learning in both cases. In colonoscopy applications, these metrics are important given the skill required for endoscopic assessment of lesions, the wide variety of endoscopy systems in use, and the homogeneity that is typical of labeled datasets.

arXiv comment10 pages, 5 figures

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Simple Framework for Contrastive Learning of Visual Representations
• Representation Learning with Contrastive Predictive Coding
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
• A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
• Unsupervised Representation Learning by Predicting Image Rotations
• Generating Videos with Scene Dynamics
• Deep Anomaly Detection with Outlier Exposure
• Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty
• Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization
• Improving out-of-distribution generalization via multi-task self-supervised pretraining
• Revisiting Rubik's Cube: Self-supervised Learning with Volume-wise Transformation for 3D Medical Image Segmentation
• Multimodal Densenet

Cited by in corpus (2)

• Deep learning in biomedical optics
• GAN Inversion for Data Augmentation to Improve Colonoscopy Lesion Classification