Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis

Abstract

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis (CAD) systems have been developed. These commonly rely on a fixed scale classifier that scans CT images, recognizes textural lung patterns and generates a map of pathologies. In a previous study, we proposed a method for classifying lung tissue patterns using a deep convolutional neural network (CNN), with an architecture designed for the specific problem. In this study, we present an improved method for training the proposed network by transferring knowledge from the similar domain of general texture classification. Six publicly available texture databases are used to pretrain networks with the proposed architecture, which are then fine-tuned on the lung tissue data. The resulting CNNs are combined in an ensemble and their fused knowledge is compressed back to a network with the original architecture. The proposed approach resulted in an absolute increase of about 2% in the performance of the proposed CNN. The results demonstrate the potential of transfer learning in the field of medical image analysis, indicate the textural nature of the problem and show that the method used for training a network can be as important as designing its architecture.

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Distilling the Knowledge in a Neural Network
• How transferable are features in deep neural networks?
• Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
• Good Practice in CNN Feature Transfer

Cited by in corpus (25)

• A Survey on Deep Learning in Medical Image Analysis
• Reliable Tuberculosis Detection using Chest X-ray with Deep Learning, Segmentation and Visualization
• Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray
• Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies
• Semantic Segmentation of Pathological Lung Tissue with Dilated Fully Convolutional Networks
• COV-ECGNET: COVID-19 detection using ECG trace images with deep convolutional neural network
• Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes
• Cats or CAT scans: transfer learning from natural or medical image source datasets?
• Ensembles of Convolutional Neural Networks models for pediatric pneumonia diagnosis
• Adversarial Multi-Source Transfer Learning in Healthcare: Application to Glucose Prediction for Diabetic People
• Small Sample Learning in Big Data Era
• Few-shot Learning for Named Entity Recognition in Medical Text
• Convolutional Neural Networks: Ensemble Modeling, Fine-Tuning and Unsupervised Semantic Localization for Intraoperative CLE Images
• Privacy-Preserving Ensemble Infused Enhanced Deep Neural Network Framework for Edge Cloud Convergence
• Explainable multiple abnormality classification of chest CT volumes
• Multi-source Transfer Learning with Ensemble for Financial Time Series Forecasting
• Semantic Segmentation of Histopathological Slides for the Classification of Cutaneous Lymphoma and Eczema
• Feature Representation Analysis of Deep Convolutional Neural Network using Two-stage Feature Transfer -An Application for Diffuse Lung Disease Classification-
• Unpaired Multi-modal Segmentation via Knowledge Distillation
• Exploring the Effect of Image Enhancement Techniques on COVID-19 Detection using Chest X-rays Images
• Aggregating From Multiple Target-Shifted Sources
• Towards smart optical focusing: Deep learning-empowered wavefront shaping in nonstationary scattering media
• A Dynamic Time Warping-Transfer Learning Approach to Transferring Knowledge in Stress-strain Behaviors from Polymers to Metals: An Affordable and Generalizable Additive Manufacturing Part Qualification Framework
• MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Models
• Bayesian Generative Models for Knowledge Transfer in MRI Semantic Segmentation Problems