Lifting Finite-Sample Gaussian Approximation of Wide Neural Networks to Functional Convergence

Luis Wiederhold, Nil Ayday, Debarghya Ghoshdastidar

Randomly initialised neural networks of width $m$ converge to Gaussian processes as $m\to \infty$, with two types of quantitative bounds characterising this convergence. Finite-sa…