Multi-layer random features and the approximation power of neural networks

Rustem Takhanov

A neural architecture with randomly initialized weights, in the infinite width limit, is equivalent to a Gaussian Random Field whose covariance function is the so-called Neural Net…