Towards Data-Efficient Learning: A Benchmark for COVID-19 CT Lung and Infection Segmentation

Abstract

Purpose: Accurate segmentation of lung and infection in COVID-19 CT scans plays an important role in the quantitative management of patients. Most of the existing studies are based on large and private annotated datasets that are impractical to obtain from a single institution, especially when radiologists are busy fighting the coronavirus disease. Furthermore, it is hard to compare current COVID-19 CT segmentation methods as they are developed on different datasets, trained in different settings, and evaluated with different metrics. Methods: To promote the development of data-efficient deep learning methods, in this paper, we built three benchmarks for lung and infection segmentation based on 70 annotated COVID-19 cases, which contain current active research areas, e.g., few-shot learning, domain generalization, and knowledge transfer. For a fair comparison among different segmentation methods, we also provide standard training, validation and testing splits, evaluation metrics and, the corresponding code. Results: Based on the state-of-the-art network, we provide more than 40 pre-trained baseline models, which not only serve as out-of-the-box segmentation tools but also save computational time for researchers who are interested in COVID-19 lung and infection segmentation. We achieve average Dice Similarity Coefficient (DSC) scores of 97.3\%, 97.7\%, and 67.3\% and average Normalized Surface Dice (NSD) scores of 90.6\%, 91.4\%, and 70.0\% for left lung, right lung, and infection, respectively. Conclusions: To the best of our knowledge, this work presents the first data-efficient learning benchmark for medical image segmentation and the largest number of pre-trained models up to now. All these resources are publicly available, and our work lays the foundation for promoting the development of deep learning methods for efficient COVID-19 CT segmentation with limited data.

arXiv commentaccepted for publication in Medical Physics

References in corpus (7)

• Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation and Diagnosis for COVID-19
• Domain Generalization via Model-Agnostic Learning of Semantic Features
• MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Data
• Data augmentation using learned transformations for one-shot medical image segmentation
• Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis
• Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
• Annotation-Free Cardiac Vessel Segmentation via Knowledge Transfer from Retinal Images

Cited by in corpus (4)

• Diagnosis of COVID-19 Using Machine Learning and Deep Learning: A review
• Domain adaptation based self-correction model for COVID-19 infection segmentation in CT images
• A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels
• Lung-DDPM+: Efficient Thoracic CT Image Synthesis using Diffusion Probabilistic Model