Multi-modal AsynDGAN: Learn From Distributed Medical Image Data without Sharing Private Information
arXiv:2012.08604
Abstract
As deep learning technologies advance, increasingly more data is necessary to generate general and robust models for various tasks. In the medical domain, however, large-scale and multi-parties data training and analyses are infeasible due to the privacy and data security concerns. In this paper, we propose an extendable and elastic learning framework to preserve privacy and security while enabling collaborative learning with efficient communication. The proposed framework is named distributed Asynchronized Discriminator Generative Adversarial Networks (AsynDGAN), which consists of a centralized generator and multiple distributed discriminators. The advantages of our proposed framework are five-fold: 1) the central generator could learn the real data distribution from multiple datasets implicitly without sharing the image data; 2) the framework is applicable for single-modality or multi-modality data; 3) the learned generator can be used to synthesize samples for down-stream learning tasks to achieve close-to-real performance as using actual samples collected from multiple data centers; 4) the synthetic samples can also be used to augment data or complete missing modalities for one single data center; 5) the learning process is more efficient and requires lower bandwidth than other distributed deep learning methods.
arXiv admin note: text overlap with arXiv:2006.00080
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- A Survey on Deep Learning in Medical Image Analysis
- Conditional Generative Adversarial Nets
- Deep Learning with Differential Privacy
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Federated Learning: Strategies for Improving Communication Efficiency
- Federated Learning for Mobile Keyboard Prediction
- Data Augmentation Generative Adversarial Networks
- A review: Deep learning for medical image segmentation using multi-modality fusion
- Split learning for health: Distributed deep learning without sharing raw patient data
- CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learning