Uniform-in-time concentration in two-layer neural networks via transportation inequalities

Arnaud Guillin, Boris Nectoux, Paul Stos

We quantify, uniformly over time and with high probability, the discrepancy between the predictions of a two-layer neural network trained by stochastic gradient descent (SGD) and t…