Fluctuations of Nonlinear Observables in Mean Field Neural Network Training

Arnaud Descours, Geoffrey Lacour

Mean field limits describe the training dynamics of wide neural networks through the evolution of the empirical distribution of their parameters. Although functional central limit…