Implicit Regularization of Large Neural Networks via Mean-Field Formulation

Beatrice Acciaio, Jakob Heiss, Gudmund Pammer +1

We propose a mathematical framework to explain implicit regularization from early stopping during the training of overparametrized neural networks. In the mean-field limit, the par…