Federated Multi-organ Segmentation with Inconsistent Labels
arXiv:2206.07156 · doi:10.1109/TMI.2023.3270140
Abstract
Federated learning is an emerging paradigm allowing large-scale decentralized learning without sharing data across different data owners, which helps address the concern of data privacy in medical image analysis. However, the requirement for label consistency across clients by the existing methods largely narrows its application scope. In practice, each clinical site may only annotate certain organs of interest with partial or no overlap with other sites. Incorporating such partially labeled data into a unified federation is an unexplored problem with clinical significance and urgency. This work tackles the challenge by using a novel federated multi-encoding U-Net (Fed-MENU) method for multi-organ segmentation. In our method, a multi-encoding U-Net (MENU-Net) is proposed to extract organ-specific features through different encoding sub-networks. Each sub-network can be seen as an expert of a specific organ and trained for that client. Moreover, to encourage the organ-specific features extracted by different sub-networks to be informative and distinctive, we regularize the training of the MENU-Net by designing an auxiliary generic decoder (AGD). Extensive experiments on six public abdominal CT datasets show that our Fed-MENU method can effectively obtain a federated learning model using the partially labeled datasets with superior performance to other models trained by either localized or centralized learning methods. Source code is publicly available at https://github.com/DIAL-RPI/Fed-MENU.
arXiv commentv1: 10 pages, 5 figures; v2: 14 pages, 5 figures, accepted by IEEE Transactions on Medical Imaging (TMI), published version available at https://doi.org/10.1109/TMI.2023.3270140, source code available at https://github.com/DIAL-RPI/Fed-MENU
References in corpus (11)
- Automated Design of Deep Learning Methods for Biomedical Image Segmentation
- Instance Normalization: The Missing Ingredient for Fast Stylization
- The Medical Segmentation Decathlon
- A large annotated medical image dataset for the development and evaluation of segmentation algorithms
- Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification
- The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes
- AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation
- Federated Learning for Breast Density Classification: A Real-World Implementation
- Auto-FedAvg: Learnable Federated Averaging for Multi-Institutional Medical Image Segmentation
- FedNorm: Modality-Based Normalization in Federated Learning for Multi-Modal Liver Segmentation
- Federated Cross Learning for Medical Image Segmentation