On Learning Rates and Schrödinger Operators

Bin Shi, Weijie J. Su, Michael I. Jordan

The learning rate is perhaps the single most important parameter in the training of neural networks and, more broadly, in stochastic (nonconvex) optimization. Accordingly, there ar…