Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labels

Abstract

Due to the rapid advancements in recent years, medical image analysis is largely dominated by deep learning (DL). However, building powerful and robust DL models requires training with large multi-party datasets. While multiple stakeholders have provided publicly available datasets, the ways in which these data are labeled vary widely. For Instance, an institution might provide a dataset of chest radiographs containing labels denoting the presence of pneumonia, while another institution might have a focus on determining the presence of metastases in the lung. Training a single AI model utilizing all these data is not feasible with conventional federated learning (FL). This prompts us to propose an extension to the widespread FL process, namely flexible federated learning (FFL) for collaborative training on such data. Using 695,000 chest radiographs from five institutions from across the globe - each with differing labels - we demonstrate that having heterogeneously labeled datasets, FFL-based training leads to significant performance increase compared to conventional FL training, where only the uniformly annotated images are utilized. We believe that our proposed algorithm could accelerate the process of bringing collaborative training methods from research and simulation phase to the real-world applications in healthcare.

Published in Nature Scientific Reports

References in corpus (1)

• NegBio: a high-performance tool for negation and uncertainty detection in radiology reports

Cited by in corpus (8)

• Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imaging
• Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images
• Mind the Gap: Federated Learning Broadens Domain Generalization in Diagnostic AI Models
• Federated learning for secure development of AI models for Parkinson's disease detection using speech from different languages
• Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacy
• Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations
• Resolution scaling governs DINOv3 transfer performance in chest radiograph classification
• Effect of Reporting Mode and Clinical Experience on Radiologists' Gaze and Image Analysis Behavior in Chest Radiography