542 citations · 1.1k across the 46 of their papers we have counts for
52 papers
An information theorist's tour of differential privacy
Anand D. Sarwate, Flavio P. Calmon, Oliver Kosut +1
Since being proposed in 2006, differential privacy has become a standard method for quantifying certain risks in publishing or sharing analyses of sensitive data. At its heart, dif…
Sliding Window Adversarial Channels
Bikash Kumar Dey, Sidharth Jaggi, Michael Langberg +2
In an arbitrarily varying channel (AVC), the channel has a state which is under the control of an adversarial jammer and the corresponding capacities are often functions of the "po…
Structured Low-Rank Tensors for Generalized Linear Models
Batoul Taki, Anand D. Sarwate, Waheed U. Bajwa
Recent works have shown that imposing tensor structures on the coefficient tensor in regression problems can lead to more reliable parameter estimation and lower sample complexity…
Minibatching Offers Improved Generalization Performance for Second Order Optimizers
Eric Silk, Swarnita Chakraborty, Nairanjana Dasgupta +3
Training deep neural networks (DNNs) used in modern machine learning is computationally expensive. Machine learning scientists, therefore, rely on stochastic first-order methods fo…
Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models
Andrew Engel, Zhichao Wang, Natalie S. Frank +4
A recent trend in explainable AI research has focused on surrogate modeling, where neural networks are approximated as simpler ML algorithms such as kernel machines. A second trend…
Spectral Evolution and Invariance in Linear-width Neural Networks
Zhichao Wang, Andrew Engel, Anand Sarwate +2
We investigate the spectral properties of linear-width feed-forward neural networks, where the sample size is asymptotically proportional to network width. Empirically, we show tha…