Convergence of continuous-time stochastic gradient descent with applications to deep neural networks

Gabor Lugosi, Eulalia Nualart

We study a continuous-time approximation of the stochastic gradient descent process for minimizing the population expected loss in learning problems. The main results establish gen…