Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD

Dmitry Dudukalov, Artem Logachov, Vladimir Lotov +3

We study the convergence properties and escape dynamics of Stochastic Gradient Descent (SGD) in one-dimensional landscapes, separately considering infinite- and finite-variance noi…