Robust and Explainable Framework to Address Data Scarcity in Diagnostic Imaging

Abstract

Deep learning has significantly advanced automatic medical diagnostics and released the occupation of human resources to reduce clinical pressure, yet the persistent challenge of data scarcity in this area hampers its further improvements and applications. To address this gap, we introduce a novel ensemble framework called `Efficient Transfer and Self-supervised Learning based Ensemble Framework' (ETSEF). ETSEF leverages features from multiple pre-trained deep learning models to efficiently learn powerful representations from a limited number of data samples. To the best of our knowledge, ETSEF is the first strategy that combines two pre-training methodologies (Transfer Learning and Self-supervised Learning) with ensemble learning approaches. Various data enhancement techniques, including data augmentation, feature fusion, feature selection, and decision fusion, have also been deployed to maximise the efficiency and robustness of the ETSEF model. Five independent medical imaging tasks, including endoscopy, breast cancer, monkeypox, brain tumour, and glaucoma detection, were tested to demonstrate ETSEF's effectiveness and robustness. Facing limited sample numbers and challenging medical tasks, ETSEF has proved its effectiveness by improving diagnostics accuracies from 10\% to 13.3\% when compared to strong ensemble baseline models and up to 14.4\% improvements compared with published state-of-the-art methods. Moreover, we emphasise the robustness and trustworthiness of the ETSEF method through various vision-explainable artificial intelligence techniques, including Grad-CAM, SHAP, and t-SNE. Compared to those large-scale deep learning models, ETSEF can be deployed flexibly and maintain superior performance for challenging medical imaging tasks, showing the potential to be applied to more areas that lack training data

64 pages, 20 figures

References in corpus (17)

• Ensemble deep learning: A review
• Improved Baselines with Momentum Contrastive Learning
• Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• Recent advances and clinical applications of deep learning in medical image analysis
• EXPANSE: A Deep Continual / Progressive Learning System for Deep Transfer Learning
• A Review of Deep Transfer Learning and Recent Advancements
• Transfusion: Understanding Transfer Learning for Medical Imaging
• Self-Supervised Representation Learning: Introduction, Advances and Challenges
• A Survey on Negative Transfer
• Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
• Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
• MedMamba: Vision Mamba for Medical Image Classification
• Self-Supervised Pre-Training with Contrastive and Masked Autoencoder Methods for Dealing with Small Datasets in Deep Learning for Medical Imaging
• SelfFed: Self-Supervised Federated Learning for Data Heterogeneity and Label Scarcity in Medical Images
• Evaluating the Robustness of Self-Supervised Learning in Medical Imaging
• Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planes