Proportional infinite-width infinite-depth limit for deep linear neural networks

Federico Bassetti, Lucia Ladelli, Pietro Rotondo

We study the distributional properties of linear neural networks with random parameters in the context of large networks, where the number of layers diverges in proportion to the n…