Decentralized Personalization for Federated Medical Image Segmentation via Gossip Contrastive Mutual Learning

Abstract

Federated Learning (FL) presents a promising avenue for collaborative model training among medical centers, facilitating knowledge exchange without compromising data privacy. However, vanilla FL is prone to server failures and rarely achieves optimal performance on all participating sites due to heterogeneous data distributions among them. To overcome these challenges, we propose Gossip Contrastive Mutual Learning (GCML), a unified framework to optimize personalized models in a decentralized environment, where Gossip Protocol is employed for flexible and robust peer-to-peer communication. To make efficient and reliable knowledge exchange in each communication without the global knowledge across all the sites, we introduce deep contrast mutual learning (DCML), a simple yet effective scheme to encourage knowledge transfer between the incoming and local models through collaborative training on local data. By integrating DCML with other efforts to optimize site-specific models by leveraging useful information from peers, we evaluated the performance and efficiency of the proposed method on three publicly available datasets with different segmentation tasks. Our extensive experimental results show that the proposed GCML framework outperformed both centralized and decentralized FL methods with significantly reduced communication overhead, indicating its potential for real-world deployment. Upon the acceptance of manuscript, the code will be available at: https://github.com/CUMC-Yuan-Lab/GCML.

Accepted by IEEE Transactions on Medical Imaging, Open-source code at: https://github.com/CUMC-Yuan-Lab/GCML

References in corpus (11)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Automated Design of Deep Learning Methods for Biomedical Image Segmentation
• The Future of Digital Health with Federated Learning
• FedKD: Communication Efficient Federated Learning via Knowledge Distillation
• Federated Learning Enables Big Data for Rare Cancer Boundary Detection
• Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imaging
• Decentralized Federated Learning through Proxy Model Sharing
• A Decentralized Federated Learning Framework via Committee Mechanism with Convergence Guarantee
• Decentralized Federated Learning via Mutual Knowledge Transfer
• Do Gradient Inversion Attacks Make Federated Learning Unsafe?
• Federated brain tumor segmentation: an extensive benchmark