311 citations · 601 across the 23 of their papers we have counts for
23 papers
Advancing Differential Privacy: Where We Are Now and Future Directions for Real-World Deployment
Rachel Cummings, Damien Desfontaines, David Evans +21
In this article, we present a detailed review of current practices and state-of-the-art methodologies in the field of differential privacy (DP), with a focus of advancing DP's depl…
Multi-Task Differential Privacy Under Distribution Skew
Walid Krichene, Prateek Jain, Shuang Song +3
We study the problem of multi-task learning under user-level differential privacy, in which users contribute data to tasks, each involving a subset of users. One important…
Measuring Forgetting of Memorized Training Examples
Matthew Jagielski, Om Thakkar, Florian Tramèr +8
Machine learning models exhibit two seemingly contradictory phenomena: training data memorization, and various forms of forgetting. In memorization, models overfit specific trainin…
Debugging Differential Privacy: A Case Study for Privacy Auditing
Florian Tramer, Andreas Terzis, Thomas Steinke +3
Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspir…
Toward Training at ImageNet Scale with Differential Privacy
Alexey Kurakin, Shuang Song, Steve Chien +3
Differential privacy (DP) is the de facto standard for training machine learning (ML) models, including neural networks, while ensuring the privacy of individual examples in the tr…
Membership Inference Attacks From First Principles
Nicholas Carlini, Steve Chien, Milad Nasr +3
A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dat…
Public Data-Assisted Mirror Descent for Private Model Training
Ehsan Amid, Arun Ganesh, Rajiv Mathews +6
In this paper, we revisit the problem of using in-distribution public data to improve the privacy/utility trade-offs for differentially private (DP) model training. (Here, public d…
Private Alternating Least Squares: Practical Private Matrix Completion with Tighter Rates
Steve Chien, Prateek Jain, Walid Krichene +4
We study the problem of differentially private (DP) matrix completion under user-level privacy. We design a joint differentially private variant of the popular Alternating-Least-Sq…
Practical and Private (Deep) Learning without Sampling or Shuffling
Peter Kairouz, Brendan McMahan, Shuang Song +3
We consider training models with differential privacy (DP) using mini-batch gradients. The existing state-of-the-art, Differentially Private Stochastic Gradient Descent (DP-SGD), r…
Adversary Instantiation: Lower Bounds for Differentially Private Machine Learning
Milad Nasr, Shuang Song, Abhradeep Thakurta +2
Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, wh…
Is Private Learning Possible with Instance Encoding?
Nicholas Carlini, Samuel Deng, Sanjam Garg +6
A private machine learning algorithm hides as much as possible about its training data while still preserving accuracy. In this work, we study whether a non-private learning algori…
Tempered Sigmoid Activations for Deep Learning with Differential Privacy
Nicolas Papernot, Abhradeep Thakurta, Shuang Song +2
Because learning sometimes involves sensitive data, machine learning algorithms have been extended to offer privacy for training data. In practice, this has been mostly an aftertho…
Evading Curse of Dimensionality in Unconstrained Private GLMs via Private Gradient Descent
Shuang Song, Thomas Steinke, Om Thakkar +1
We revisit the well-studied problem of differentially private empirical risk minimization (ERM). We show that for unconstrained convex generalized linear models (GLMs), one can obt…
Encode, Shuffle, Analyze Privacy Revisited: Formalizations and Empirical Evaluation
Úlfar Erlingsson, Vitaly Feldman, Ilya Mironov +4
Recently, a number of approaches and techniques have been introduced for reporting software statistics with strong privacy guarantees. These range from abstract algorithms to compr…
Combining MixMatch and Active Learning for Better Accuracy with Fewer Labels
Shuang Song, David Berthelot, Afshin Rostamizadeh
We propose using active learning based techniques to further improve the state-of-the-art semi-supervised learning MixMatch algorithm. We provide a thorough empirical evaluation of…
That which we call private
Úlfar Erlingsson, Ilya Mironov, Ananth Raghunathan +1
The guarantees of security and privacy defenses are often strengthened by relaxing the assumptions made about attackers or the context in which defenses are deployed. Such relaxati…
Differentially Private Continual Release of Graph Statistics
Shuang Song, Susan Little, Sanjay Mehta +2
Motivated by understanding the dynamics of sensitive social networks over time, we consider the problem of continual release of statistics in a network that arrives online, while p…
Scalable Private Learning with PATE
Nicolas Papernot, Shuang Song, Ilya Mironov +3
The rapid adoption of machine learning has increased concerns about the privacy implications of machine learning models trained on sensitive data, such as medical records or other…
Rényi Differential Privacy Mechanisms for Posterior Sampling
Joseph Geumlek, Shuang Song, Kamalika Chaudhuri
Using a recently proposed privacy definition of Rényi Differential Privacy (RDP), we re-examine the inherent privacy of releasing a single sample from a posterior distribution. We…
Composition Properties of Inferential Privacy for Time-Series Data
Shuang Song, Kamalika Chaudhuri
With the proliferation of mobile devices and the internet of things, developing principled solutions for privacy in time series applications has become increasingly important. Whil…
Pufferfish Privacy Mechanisms for Correlated Data
Shuang Song, Yizhen Wang, Kamalika Chaudhuri
Many modern databases include personal and sensitive correlated data, such as private information on users connected together in a social network, and measurements of physical acti…
Learning from Data with Heterogeneous Noise using SGD
Shuang Song, Kamalika Chaudhuri, Anand D. Sarwate
We consider learning from data of variable quality that may be obtained from different heterogeneous sources. Addressing learning from heterogeneous data in its full generality is…
The Large Margin Mechanism for Differentially Private Maximization
Kamalika Chaudhuri, Daniel Hsu, Shuang Song
A basic problem in the design of privacy-preserving algorithms is the private maximization problem: the goal is to pick an item from a universe that (approximately) maximizes a dat…