Edge of chaos and avalanches in neural networks with heavy-tailed synaptic weight distribution

Abstract

We propose an analytically tractable neural connectivity model with power-law distributed synaptic strengths. When threshold neurons with biologically plausible number of incoming connections are considered, our model features a continuous transition to chaos and can reproduce biologically relevant low activity levels and scale-free avalanches, i.e. bursts of activity with power-law distributions of sizes and lifetimes. In contrast, the Gaussian counterpart exhibits a discontinuous transition to chaos and thus cannot be poised near the edge of chaos. We validate our predictions in simulations of networks of binary as well as leaky integrate-and-fire neurons. Our results suggest that heavy-tailed synaptic distribution may form a weakly informative sparse-connectivity prior that can be useful in biological and artificial adaptive systems.

Accepted for publication in Physical Review Letters

References in corpus (19)

• A weakly informative default prior distribution for logistic and other regression models
• Universality classes in nonequilibrium lattice systems
• Optimal Dynamical Range of Excitable Networks at Criticality
• Colloquium: Criticality and dynamical scaling in living systems
• Macroscopic description for networks of spiking neurons
• Stimulus-Dependent Suppression of Chaos in Recurrent Neural Networks
• Landau-Ginzburg theory of cortex dynamics: Scale-free avalanches emerge at the edge of synchronization
• Avalanche and spreading exponents in systems with absorbing states
• Transition to chaos in random neuronal networks
• Transition to chaos in random networks with cell-type-specific connectivity
• Dynamics of Random Neural Networks with Bistable Units
• Lyapunov Exponents in Random Boolean Networks
• Optimal sequence memory in driven random networks
• Path Integral Approach to Random Neural Networks
• Hysteresis, neural avalanches and critical behaviour near a first-order transition of a spiking neural network
• Mean Field Theory of Dynamical Systems Driven by External Signals
• Auditory power-law activation-avalanches exhibit a fundamental computational ground-state
• From synaptic interactions to collective dynamics in random neuronal networks models: critical role of eigenvectors and transient behavior
• Role of zero synapses in unsupervised feature learning

Cited by in corpus (17)

• Modular architecture facilitates noise-driven control of synchrony in neuronal networks
• Does the brain behave like a (complex) network? I. Dynamics
• Quantum reservoir computation utilising scale-free networks
• Transient chaotic dimensionality expansion by recurrent networks
• Increasing Liquid State Machine Performance with Edge-of-Chaos Dynamics Organized by Astrocyte-modulated Plasticity
• Threshold cascade dynamics on signed random networks
• Extended Anderson Criticality in Heavy-Tailed Neural Networks
• Suppression of chaos in a partially driven recurrent neural network
• Impact of the form of weighted networks on the quantum extreme reservoir computation
• Effect of Synaptic Heterogeneity on Neuronal Coordination
• Ensemble perspective for understanding temporal credit assignment
• Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks
• Discontinuous transition to chaos in a canonical random neural network
• Phase transitions from linear to nonlinear information processing in neural networks
• Excitatory/Inhibitory Balance Emerges as a Key Factor for RBN Performance, Overriding Attractor Dynamics
• Impact of heavy-tailed synaptic strength distributions on self-sustained activity in networks of spiking neurons
• Stability of travelling wave solutions to reaction-diffusion equations driven by additive noise with Hölder continuous paths