DPD-InfoGAN: Differentially Private Distributed InfoGAN
arXiv:2010.11398
Abstract
Generative Adversarial Networks (GANs) are deep learning architectures capable of generating synthetic datasets. Despite producing high-quality synthetic images, the default GAN has no control over the kinds of images it generates. The Information Maximizing GAN (InfoGAN) is a variant of the default GAN that introduces feature-control variables that are automatically learned by the framework, hence providing greater control over the different kinds of images produced. Due to the high model complexity of InfoGAN, the generative distribution tends to be concentrated around the training data points. This is a critical problem as the models may inadvertently expose the sensitive and private information present in the dataset. To address this problem, we propose a differentially private version of InfoGAN (DP-InfoGAN). We also extend our framework to a distributed setting (DPD-InfoGAN) to allow clients to learn different attributes present in other clients' datasets in a privacy-preserving manner. In our experiments, we show that both DP-InfoGAN and DPD-InfoGAN can synthesize high-quality images with flexible control over image attributes while preserving privacy.
References in corpus (9)
- Deep Learning with Differential Privacy
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Federated Learning: Strategies for Improving Communication Efficiency
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
- Renyi Differential Privacy
- Generative Moment Matching Networks
- Differentially Private Generative Adversarial Network
- Differentially Private Data Generative Models