Distributed generation of privacy preserving data with user customization
arXiv:1904.09415
Abstract
Distributed devices such as mobile phones can produce and store large amounts of data that can enhance machine learning models; however, this data may contain private information specific to the data owner that prevents the release of the data. We wish to reduce the correlation between user-specific private information and data while maintaining the useful information. Rather than learning a large model to achieve privatization from end to end, we introduce a decoupling of the creation of a latent representation and the privatization of data that allows user-specific privatization to occur in a distributed setting with limited computation and minimal disturbance on the utility of the data. We leverage a Variational Autoencoder (VAE) to create a compact latent representation of the data; however, the VAE remains fixed for all devices and all possible private labels. We then train a small generative filter to perturb the latent representation based on individual preferences regarding the private and utility information. The small filter is trained by utilizing a GAN-type robust optimization that can take place on a distributed device. We conduct experiments on three popular datasets: MNIST, UCI-Adult, and CelebA, and give a thorough evaluation including visualizing the geometry of the latent embeddings and estimating the empirical mutual information to show the effectiveness of our approach.
accepted in ICLR 2019 SafeML workshop
References in corpus (17)
- Adam: A Method for Stochastic Optimization
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Equality of Opportunity in Supervised Learning
- Towards Deep Learning Models Resistant to Adversarial Attacks
- Provable defenses against adversarial examples via the convex outer adversarial polytope
- Estimating divergence functionals and the likelihood ratio by convex risk minimization
- Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations
- Learning Adversarially Fair and Transferable Representations
- Learning to Protect Communications with Adversarial Neural Cryptography
- Censoring Representations with an Adversary
- Stronger Data Poisoning Attacks Break Data Sanitization Defenses
- Learning Controllable Fair Representations
- Minimax Filter: Learning to Preserve Privacy from Inference Attacks
- DEEProtect: Enabling Inference-based Access Control on Mobile Sensing Applications
- Understanding Compressive Adversarial Privacy
- Application-driven Privacy-preserving Data Publishing with Correlated Attributes