Law of large numbers and central limit theorem for wide two-layer neural networks: the mini-batch and noisy case

Arnaud Descours, Arnaud Guillin, Manon Michel +1

In this work, we consider a wide two-layer neural network and study the behavior of its empirical weights under a dynamics set by a stochastic gradient descent along the quadratic…