13 citations · 13 across the 1 of their papers we have counts for
2 papers
cs.LG2020★ 13 cited
On Learning Rates and Schrödinger Operators
Bin Shi, Weijie J. Su, Michael I. Jordan
The learning rate is perhaps the single most important parameter in the training of neural networks and, more broadly, in stochastic (nonconvex) optimization. Accordingly, there ar…
math.OC2019
Acceleration via Symplectic Discretization of High-Resolution Differential Equations
Bin Shi, Simon S. Du, Weijie J. Su +1
We study first-order optimization methods obtained by discretizing ordinary differential equations (ODEs) corresponding to Nesterov's accelerated gradient methods (NAGs) and Polyak…