Wide Deep Neural Networks with Gaussian Weights are Very Close to Gaussian Processes

Dario Trevisan

We establish novel rates for the Gaussian approximation of random deep neural networks with Gaussian parameters (weights and biases) and Lipschitz activation functions, in the wide…