Error estimates between SGD with momentum and underdamped Langevin diffusion

Arnaud Guillin, Yu Wang, Lihu Xu +1

Stochastic gradient descent with momentum is a popular variant of stochastic gradient descent, which has recently been reported to have a close relationship with the underdamped La…