Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Images

Abstract

The current pandemic, caused by the outbreak of a novel coronavirus (COVID-19) in December 2019, has led to a global emergency that has significantly impacted economies, healthcare systems and personal wellbeing all around the world. Controlling the rapidly evolving disease requires highly sensitive and specific diagnostics. While real-time RT-PCR is the most commonly used, these can take up to 8 hours, and require significant effort from healthcare professionals. As such, there is a critical need for a quick and automatic diagnostic system. Diagnosis from chest CT images is a promising direction. However, current studies are limited by the lack of sufficient training samples, as acquiring annotated CT images is time-consuming. To this end, we propose a new deep learning algorithm for the automated diagnosis of COVID-19, which only requires a few samples for training. Specifically, we use contrastive learning to train an encoder which can capture expressive feature representations on large and publicly available lung datasets and adopt the prototypical network for classification. We validate the efficacy of the proposed model in comparison with other competing methods on two publicly available and annotated COVID-19 CT datasets. Our results demonstrate the superior performance of our model for the accurate diagnosis of COVID-19 based on chest CT images.

References in corpus (18)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Simple Framework for Contrastive Learning of Visual Representations
• Representation Learning with Contrastive Predictive Coding
• Prototypical Networks for Few-shot Learning
• DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
• Improved Baselines with Momentum Contrastive Learning
• Learning deep representations by mutual information estimation and maximization
• Automatic Detection of Coronavirus Disease (COVID-19) Using X-ray Images and Deep Convolutional Neural Networks
• Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
• Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation and Diagnosis for COVID-19
• Data-Efficient Image Recognition with Contrastive Predictive Coding
• COVID-CT-Dataset: A CT Scan Dataset about COVID-19
• Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis
• Learning Representations by Maximizing Mutual Information Across Views
• Large Scale Adversarial Representation Learning
• Residual Attention U-Net for Automated Multi-Class Segmentation of COVID-19 Chest CT Images
• Deep Feature Augmentation for Occluded Image Classification
• Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-scale Lesion Database

Cited by in corpus (15)

• Recent advances and clinical applications of deep learning in medical image analysis
• Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans
• Self-supervised learning methods and applications in medical imaging analysis: A survey
• Study on Transfer Learning Capabilities for Pneumonia Classification in Chest-X-Rays Image
• Self-Supervised Pre-Training with Contrastive and Masked Autoencoder Methods for Dealing with Small Datasets in Deep Learning for Medical Imaging
• Improving COVID-19 CT Classification of CNNs by Learning Parameter-Efficient Representation
• Meta-learning in healthcare: A survey
• Generative Adversarial U-Net for Domain-free Medical Image Augmentation
• Multi-modal Masked Siamese Network Improves Chest X-Ray Representation Learning
• Less is More: Selective Reduction of CT Data for Self-Supervised Pre-Training of Deep Learning Models with Contrastive Learning Improves Downstream Classification Performance
• Fitbeat: COVID-19 Estimation based on Wristband Heart Rate
• Semantic-Aware Contrastive Learning for Multi-object Medical Image Segmentation
• Few-shot Learning for CT Scan based COVID-19 Diagnosis
• A Teacher-Student Framework with Fourier Augmentation for COVID-19 Infection Segmentation in CT Images
• Federated Contrastive Learning for Decentralized Unlabeled Medical Images