A Hessian-Aware Stochastic Differential Equation for Modelling SGD

Xiang Li, Zebang Shen, Liang Zhang +1

Continuous-time approximation of Stochastic Gradient Descent (SGD) is a crucial tool to study its escaping behaviors from stationary points. However, existing stochastic differenti…