77 citations · 318 across the 57 of their papers we have counts for
3 papers · 1 filter
Gradient descent with adaptive stepsize converges (nearly) linearly under fourth-order growth
Damek Davis, Dmitriy Drusvyatskiy, Liwei Jiang
A prevalent belief among optimization specialists is that linear convergence of gradient descent is contingent on the function growing quadratically away from its minimizers. In th…
The radius of statistical efficiency
Joshua Cutler, Mateo Díaz, Dmitriy Drusvyatskiy
Classical results in asymptotic statistics show that the Fisher information matrix controls the difficulty of estimating a statistical model from observed data. In this work, we in…
Linear Recursive Feature Machines provably recover low-rank matrices
Adityanarayanan Radhakrishnan, Mikhail Belkin, Dmitriy Drusvyatskiy
A fundamental problem in machine learning is to understand how neural networks make accurate predictions, while seemingly bypassing the curse of dimensionality. A possible explanat…