Evolution-aware VAriance (EVA) Coreset Selection for Medical Image Classification

Abstract

In the medical field, managing high-dimensional massive medical imaging data and performing reliable medical analysis from it is a critical challenge, especially in resource-limited environments such as remote medical facilities and mobile devices. This necessitates effective dataset compression techniques to reduce storage, transmission, and computational cost. However, existing coreset selection methods are primarily designed for natural image datasets, and exhibit doubtful effectiveness when applied to medical image datasets due to challenges such as intra-class variation and inter-class similarity. In this paper, we propose a novel coreset selection strategy termed as Evolution-aware VAriance (EVA), which captures the evolutionary process of model training through a dual-window approach and reflects the fluctuation of sample importance more precisely through variance measurement. Extensive experiments on medical image datasets demonstrate the effectiveness of our strategy over previous SOTA methods, especially at high compression rates. EVA achieves 98.27% accuracy with only 10% training data, compared to 97.20% for the full training set. None of the compared baseline methods can exceed Random at 5% selection rate, while EVA outperforms Random by 5.61%, showcasing its potential for efficient medical image analysis.

arXiv commentAccepted by ACM Multimedia 2024 (oral), see: https://openreview.net/forum?id=m1qrB9KSYD

References in corpus (11)

• The Liver Tumor Segmentation Benchmark (LiTS)
• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification
• MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysis
• What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation
• Beyond neural scaling laws: beating power law scaling via data pruning
• Identifying Mislabeled Data using the Area Under the Margin Ranking
• Towards long-tailed, multi-label disease classification from chest X-ray: Overview of the CXR-LT challenge
• Deep Learning on a Data Diet: Finding Important Examples Early in Training
• SIMILAR: Submodular Information Measures Based Active Learning In Realistic Scenarios
• Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks