Learn distributed GAN with Temporary Discriminators
arXiv:2007.09221
Abstract
In this work, we propose a method for training distributed GAN with sequential temporary discriminators. Our proposed method tackles the challenge of training GAN in the federated learning manner: How to update the generator with a flow of temporary discriminators? We apply our proposed method to learn a self-adaptive generator with a series of local discriminators from multiple data centers. We show our design of loss function indeed learns the correct distribution with provable guarantees. The empirical experiments show that our approach is capable of generating synthetic data which is practical for real-world applications such as training a segmentation model.
Accepted by ECCV2020. Code: https://github.com/huiqu18/TDGAN-PyTorch
References in corpus (17)
- Adam: A Method for Stochastic Optimization
- Conditional Generative Adversarial Nets
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- ADADELTA: An Adaptive Learning Rate Method
- An overview of gradient descent optimization algorithms
- Federated Learning: Strategies for Improving Communication Efficiency
- Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
- Deep Learning using Rectified Linear Units (ReLU)
- Federated Learning for Mobile Keyboard Prediction
- FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation
- Differentially Private Federated Learning: A Client Level Perspective
- Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models
- MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets
- Adversarial Ranking for Language Generation
- Voice Conversion from Unaligned Corpora using Variational Autoencoding Wasserstein Generative Adversarial Networks
- Deep Generative Adversarial Networks for Compressed Sensing Automates MRI
- Continual Learning in Generative Adversarial Nets