Slow Transition to Low-Dimensional Chaos in Heavy-Tailed Recurrent Neural Networks

Yi Xie, Stefan Mihalas, Łukasz Kuśmierz

Growing evidence suggests that synaptic weights in the brain follow heavy-tailed distributions, yet most theoretical analyses of recurrent neural networks (RNNs) assume Gaussian co…