Infinitely wide limits for deep Stable neural networks: sub-linear, linear and super-linear activation functions

Alberto Bordino, Stefano Favaro, Sandra Fortini

There is a growing literature on the study of large-width properties of deep Gaussian neural networks (NNs), i.e. deep NNs with Gaussian-distributed parameters or weights, and Gaus…