Spectral complexity of deep neural networks

Simmaco Di Lillo, Domenico Marinucci, Michele Salvi +1

It is well-known that randomly initialized, push-forward, fully-connected neural networks weakly converge to isotropic Gaussian processes, in the limit where the width of all layer…