Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans

Abstract

The COVID-19 pandemic has spread globally for several months. Because its transmissibility and high pathogenicity seriously threaten people's lives, it is crucial to accurately and quickly detect COVID-19 infection. Many recent studies have shown that deep learning (DL) based solutions can help detect COVID-19 based on chest CT scans. However, most existing work focuses on 2D datasets, which may result in low quality models as the real CT scans are 3D images. Besides, the reported results span a broad spectrum on different datasets with a relatively unfair comparison. In this paper, we first use three state-of-the-art 3D models (ResNet3D101, DenseNet3D121, and MC3\_18) to establish the baseline performance on the three publicly available chest CT scan datasets. Then we propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification with the Gumbel Softmax technique to improve the searching efficiency. We further exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results. The experimental results show that our automatically searched models (CovidNet3D) outperform the baseline human-designed models on the three datasets with tens of times smaller model size and higher accuracy. Furthermore, the results also verify that CAM can be well applied in CovidNet3D for COVID-19 datasets to provide interpretability for medical diagnosis.

arXiv commentAccepted by AAAI 2021, COVID-19, Neural Architecture Search, AutoML

References in corpus (14)

• A Survey on Deep Learning in Medical Image Analysis
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Categorical Reparameterization with Gumbel-Softmax
• Neural Architecture Search: A Survey
• AutoML: A Survey of the State-of-the-Art
• SGDR: Stochastic Gradient Descent with Warm Restarts
• DARTS: Differentiable Architecture Search
• COVID-19 Image Data Collection
• COVID-CT-Dataset: A CT Scan Dataset about COVID-19
• Efficient Neural Architecture Search via Parameter Sharing
• Estimating Uncertainty and Interpretability in Deep Learning for Coronavirus (COVID-19) Detection
• Temporal 3D ConvNets: New Architecture and Transfer Learning for Video Classification
• Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detection
• Radiologist-Level COVID-19 Detection Using CT Scans with Detail-Oriented Capsule Networks

Cited by in corpus (1)

• AutoML: A Survey of the State-of-the-Art