51 citations · 72 across the 7 of their papers we have counts for
7 papers
A mixing time bound for Gibbs sampling from log-smooth log-concave distributions
Neha S. Wadia
The Gibbs sampler, also known as the coordinate hit-and-run algorithm, is a Markov chain that is widely used to draw samples from probability distributions in arbitrary dimensions.…
A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning
Neha S. Wadia, Yatin Dandi, Michael I. Jordan
The rapid progress in machine learning in recent years has been based on a highly productive connection to gradient-based optimization. Further progress hinges in part on a shift i…
Whitening and second order optimization both make information in the dataset unusable during training, and can reduce or prevent generalization
Neha S. Wadia, Daniel Duckworth, Samuel S. Schoenholz +2
Machine learning is predicated on the concept of generalization: a model achieving low error on a sufficiently large training set should also perform well on novel samples from the…
Solution to the Fokker-Planck equation for slowly driven Brownian motion: Emergent geometry and a formula for the corresponding thermodynamic metric
Neha S. Wadia, Ryan V. Zarcone, Michael R. DeWeese
Considerable progress has recently been made with geometrical approaches to understanding and controlling small out-of-equilibrium systems, but a mathematically rigorous foundation…
Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses
Charles G. Frye, James Simon, Neha S. Wadia +3
Despite the fact that the loss functions of deep neural networks are highly non-convex, gradient-based optimization algorithms converge to approximately the same performance from m…
Numerically Recovering the Critical Points of a Deep Linear Autoencoder
Charles G. Frye, Neha S. Wadia, Michael R. DeWeese +1
Numerically locating the critical points of non-convex surfaces is a long-standing problem central to many fields. Recently, the loss surfaces of deep neural networks have been exp…
Hyperfine Structure of the State and Predictions of Optical Cycling Behavior in the transition of TlF
Eric B. Norrgard, Eustace R. Edwards, Daniel J. McCarron +6
The rotational and hyperfine spectrum of the transition in TlF molecules was measured using laser-induced fluorescence from both a thermal and a cryogen…