Random Fully Connected Neural Networks as Perturbatively Solvable Hierarchies

Boris Hanin

This article considers fully connected neural networks with Gaussian random weights and biases as well as $L$ hidden layers, each of width proportional to a large parameter $n$. Fo…