204 citations · 848 across the 22 of their papers we have counts for
4 papers · 1 filter
Evaluating Gradient Inversion Attacks and Defenses in Federated Learning
Yangsibo Huang, Samyak Gupta, Zhao Song +2
Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or…
On Predicting Generalization using GANs
Yi Zhang, Arushi Gupta, Nikunj Saunshi +1
Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds…
Rip van Winkle's Razor: A Simple Estimate of Overfit to Test Data
Sanjeev Arora, Yi Zhang
Traditional statistics forbids use of test data (a.k.a. holdout data) during training. Dwork et al. 2015 pointed out that current practices in machine learning, whereby researchers…
On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)
Zhiyuan Li, Sadhika Malladi, Sanjeev Arora
It is generally recognized that finite learning rate (LR), in contrast to infinitesimal LR, is important for good generalization in real-life deep nets. Most attempted explanations…