Large Deviations of Gaussian Neural Networks with ReLU activation

Quirin Vogel

We prove a large deviation principle for deep neural networks with Gaussian weights and at most linearly growing activation functions, such as ReLU. This generalises earlier work,…