Langevin Dynamics: A Unified Perspective on Optimization via Lyapunov Potentials

August Y. Chen, Ayush Sekhari, Karthik Sridharan

We study the problem of non-convex optimization using Stochastic Gradient Langevin Dynamics (SGLD). SGLD is a natural and popular variation of stochastic gradient descent where at…