A note on diffusion limits for stochastic gradient descent

Alberto Lanconelli, Christopher S. A. Lauria

In the machine learning literature stochastic gradient descent has recently been widely discussed for its purported implicit regularization properties. Much of the theory, that att…