Infinite-width limit of deep linear neural networks

Lénaïc Chizat, Maria Colombo, Xavier Fernández-Real +1

This paper studies the infinite-width limit of deep linear neural networks initialized with random parameters. We obtain that, when the number of neurons diverges, the training dyn…