Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime

Noah Oberweis, Semih Cayci

Continuous-time models provide important insights into the training dynamics of optimization algorithms in deep learning. In this work, we establish a non-asymptotic convergence an…