Stimulus-Dependent Suppression of Chaos in Recurrent Neural Networks
arXiv:0912.3513 · doi:10.1103/PhysRevE.82.011903
Abstract
Neuronal activity arises from an interaction between ongoing firing generated spontaneously by neural circuits and responses driven by external stimuli. Using mean-field analysis, we ask how a neural network that intrinsically generates chaotic patterns of activity can remain sensitive to extrinsic input. We find that inputs not only drive network responses, they also actively suppress ongoing activity, ultimately leading to a phase transition in which chaos is completely eliminated. The critical input intensity at the phase transition is a non-monotonic function of stimulus frequency, revealing a "resonant" frequency at which the input is most effective at suppressing chaos even though the power spectrum of the spontaneous activity peaks at zero and falls exponentially. A prediction of our analysis is that the variance of neural responses should be most strongly suppressed at frequencies matching the range over which many sensory systems operate.
12 pages, 3 figures
Cited by in corpus (59)
- Complexity without chaos: Plasticity within random recurrent networks generates robust timing and motor control
- Linking connectivity, dynamics and computations in low-rank recurrent neural networks
- Recurrent Network Models Of Sequence Generation And Memory
- Large-scale neural recordings call for new insights to link brain and behavior
- Transition to chaos in random neuronal networks
- Scaling Limits of Wide Neural Networks with Weight Sharing: Gaussian Process Behavior, Gradient Independence, and Neural Tangent Kernel Derivation
- Transition to chaos in random networks with cell-type-specific connectivity
- full-FORCE: A Target-Based Method for Training Recurrent Networks
- Classification and Geometry of General Perceptual Manifolds
- Dynamics of random recurrent networks with correlated low-rank structure
- Optimal sequence memory in driven random networks
- Intrinsically-generated fluctuating activity in excitatory-inhibitory networks
- Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks
- Path Integral Approach to Random Neural Networks
- Local Dynamics in Trained Recurrent Neural Networks
- Statistical mechanics of complex neural systems and high dimensional data
- Edge of chaos and avalanches in neural networks with heavy-tailed synaptic weight distribution
- Synchronous chaos and broad band gamma rhythm in a minimal multi-layer model of primary visual cortex
- Determination of the edge of criticality in echo state networks through Fisher information maximization
- How single neuron properties shape chaotic dynamics and signal transmission in random neural networks
- Interpreting recurrent neural networks behaviour via excitable network attractors
- Dimension of activity in random neural networks
- Chaos and reliability in balanced spiking networks with temporal drive
- Using Firing-Rate Dynamics to Train Recurrent Networks of Spiking Model Neurons
- Contrasting the effects of adaptation and synaptic filtering on the timescales of dynamics in recurrent networks
- Large deviations, dynamics and phase transitions in large stochastic heterogeneous neural networks
- Multiplex visibility graphs to investigate recurrent neural networks dynamics
- Quality of internal representation shapes learning performance in feedback neural networks
- Transient chaotic dimensionality expansion by recurrent networks
- Echo State Networks with Self-Normalizing Activations on the Hyper-Sphere
- Revisiting chaos in stimulus-driven spiking networks: signal encoding and discrimination
- Increasing Liquid State Machine Performance with Edge-of-Chaos Dynamics Organized by Astrocyte-modulated Plasticity
- Johnson-Lindenstrauss Compression with Neuroscience-Based Constraints
- Eigenvalue spectra of large correlated random matrices
- Impulse-induced localized control of chaos in starlike networks
- Extended Anderson Criticality in Heavy-Tailed Neural Networks
- Consequences of Dale's law on the stability-complexity relationship of random neural networks
- Input correlations impede suppression of chaos and learning in balanced rate networks
- Suppression of chaos in a partially driven recurrent neural network
- Dynamically selected steady states and criticality in non-reciprocal networks
- Repeated sequential learning increases memory capacity via effective decorrelation in a recurrent neural network
- Unlearnable Games and "Satisficing'' Decisions: A Simple Model for a Complex World
- Time cells might be optimized for predictive capacity, not redundancy reduction or memory capacity
- Oscillations enhance time-series prediction in reservoir computing with feedback
- A characterization of the Edge of Criticality in Binary Echo State Networks
- Emergent Computations in Trained Artificial Neural Networks and Real Brains
- Structure of attractors in randomly connected networks
- Distributed Sequence Memory of Multidimensional Inputs in Recurrent Networks
- Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks
- One step back, two steps forward: interference and learning in recurrent neural networks
- Irreversibility in Non-reciprocal Chaotic Systems
- A local Echo State Property through the largest Lyapunov exponent
- Statistical Mechanics of Neural Processing of Object Manifolds
- Hierarchy of chaotic dynamics in random modular networks
- Neuronal architecture extracts statistical temporal patterns
- Chaos-guided Input Structuring for Improved Learning in Recurrent Neural Networks
- A geometrical analysis of global stability in trained feedback networks
- Symmetries constrain dynamics in a family of balanced neural networks
- Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks