A scoping review of transfer learning research on medical image analysis using ImageNet

Abstract

Objective: Employing transfer learning (TL) with convolutional neural networks (CNNs), well-trained on non-medical ImageNet dataset, has shown promising results for medical image analysis in recent years. We aimed to conduct a scoping review to identify these studies and summarize their characteristics in terms of the problem description, input, methodology, and outcome. Materials and Methods: To identify relevant studies, MEDLINE, IEEE, and ACM digital library were searched. Two investigators independently reviewed articles to determine eligibility and to extract data according to a study protocol defined a priori. Results: After screening of 8,421 articles, 102 met the inclusion criteria. Of 22 anatomical areas, eye (18%), breast (14%), and brain (12%) were the most commonly studied. Data augmentation was performed in 72% of fine-tuning TL studies versus 15% of the feature-extracting TL studies. Inception models were the most commonly used in breast related studies (50%), while VGGNet was the common in eye (44%), skin (50%) and tooth (57%) studies. AlexNet for brain (42%) and DenseNet for lung studies (38%) were the most frequently used models. Inception models were the most frequently used for studies that analyzed ultrasound (55%), endoscopy (57%), and skeletal system X-rays (57%). VGGNet was the most common for fundus (42%) and optical coherence tomography images (50%). AlexNet was the most frequent model for brain MRIs (36%) and breast X-Rays (50%). 35% of the studies compared their model with other well-trained CNN models and 33% of them provided visualization for interpretation. Discussion: This study identified the most prevalent tracks of implementation in the literature for data preparation, methodology selection and output evaluation for medical image analysis. Also, we identified several critical research gaps existing in the TL studies on medical image analysis.

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Deep Learning in Neural Networks: An Overview
• A Survey on Deep Learning in Medical Image Analysis
• Two-Stream Convolutional Networks for Action Recognition in Videos
• Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
• Searching for Activation Functions
• How much data is needed to train a medical image deep learning system to achieve necessary high accuracy?
• Detecting total hip replacement prosthesis design on preoperative radiographs using deep convolutional neural network

Cited by in corpus (15)

• Domain Adaptation for Medical Image Analysis: A Survey
• A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
• Natural Language Processing with Deep Learning for Medical Adverse Event Detection from Free-Text Medical Narratives: A Case Study of Detecting Total Hip Replacement Dislocation
• CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Images
• The use of deep learning enables high diagnostic accuracy in detecting syndesmotic instability on weight-bearing CT scanning
• Water quality polluted by total suspended solids classified within an Artificial Neural Network approach
• Towards Transfer Learning for Large-Scale Image Classification Using Annealing-based Quantum Boltzmann Machines
• Self-Paced Contrastive Learning for Semi-supervised Medical Image Segmentation with Meta-labels
• Multi-task neural networks by learned contextual inputs
• Deep learning for autism detection using clinical notes: A comparison of transfer learning for a transparent and black-box approach
• Analysis of the Two-Step Heterogeneous Transfer Learning for Laryngeal Blood Vessel Classification: Issue and Improvement
• Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning
• Cascading Neural Network Methodology for Artificial Intelligence-Assisted Radiographic Detection and Classification of Lead-Less Implanted Electronic Devices within the Chest
• Emissivity Prediction of Functionalized Surfaces Using Artificial Intelligence
• One-step learning algorithm selection for classification via convolutional neural networks