18 citations · 25 across the 8 of their papers we have counts for
10 papers
Actually, All Learnable Distribution Classes Are Privately Learnable
Mohammad Afzali, Hassan Ashtiani, Alex Bie +4
We show that every class of distributions that is learnable up to arbitrarily small target error in total variation distance with finitely many samples is also learnable under ($\v…
SimHack: Predicting the onset of detectable reward hacking before RL training
Junwei Deng, Alex Bie, Natalia Ponomareva
When training LLMs to code with reinforcement learning, reward hacking is often detectable but difficult to prevent, since (a) environment hardening is increasingly difficult as tr…
On the Learnability of Distribution Classes with Adaptive Adversaries
Tosca Lechner, Alex Bie, Gautam Kamath
We consider the question of learnability of distribution classes in the presence of adaptive adversaries -- that is, adversaries capable of intercepting the samples requested by a…
Distribution Learnability and Robustness
Shai Ben-David, Alex Bie, Gautam Kamath +1
We examine the relationship between learnability and robust (or agnostic) learnability for the problem of distribution learning. We show that, contrary to other learning settings (…
Private Distribution Learning with Public Data: The View from Sample Compression
Shai Ben-David, Alex Bie, Clément L. Canonne +2
We study the problem of private distribution learning with access to public data. In this setup, which we refer to as public-private learning, the learner is given public and priva…
Understanding the Role of Layer Normalization in Label-Skewed Federated Learning
Guojun Zhang, Mahdi Beitollahi, Alex Bie +1
Layer normalization (LN) is a widely adopted deep learning technique especially in the era of foundation models. Recently, LN has been shown to be surprisingly effective in federat…
Private GANs, Revisited
Alex Bie, Gautam Kamath, Guojun Zhang
We show that the canonical approach for training differentially private GANs -- updating the discriminator with differentially private stochastic gradient descent (DPSGD) -- can yi…
Private Estimation with Public Data
Alex Bie, Gautam Kamath, Vikrant Singhal
We initiate the study of differentially private (DP) estimation with access to a small amount of public data. For private estimation of d-dimensional Gaussians, we assume that the…
Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence
Tianshi Cao, Alex Bie, Arash Vahdat +2
Although machine learning models trained on massive data have led to break-throughs in several areas, their deployment in privacy-sensitive domains remains limited due to restricte…
A Simplified Fully Quantized Transformer for End-to-end Speech Recognition
Alex Bie, Bharat Venkitesh, Joao Monteiro +2
While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use…