Symmetries in Overparametrized Neural Networks: A Mean-Field View

Javier Maass, Joaquin Fontbona

We develop a Mean-Field (MF) view of the learning dynamics of overparametrized Artificial Neural Networks (NN) under data symmetric in law wrt the action of a general compact group…