Optimal sequence memory in driven random networks

Abstract

Autonomous randomly coupled neural networks display a transition to chaos at a critical coupling strength. We here investigate the effect of a time-varying input on the onset of chaos and the resulting consequences for information processing. Dynamic mean-field theory yields the statistics of the activity, the maximum Lyapunov exponent, and the memory capacity of the network. We find an exact condition that determines the transition from stable to chaotic dynamics and the sequential memory capacity in closed form. The input suppresses chaos by a dynamic mechanism, shifting the transition to significantly larger coupling strengths than predicted by local stability analysis. Beyond linear stability, a regime of coexistent locally expansive, but non-chaotic dynamics emerges that optimizes the capacity of the network to store sequential input.

References in corpus (11)

• The Kuramoto model in complex networks
• Recurrent Network Models Of Sequence Generation And Memory
• Transition to chaos in random networks with cell-type-specific connectivity
• Topological and Dynamical Complexity of Random Neural Networks
• Dynamical Entropy Production in Spiking Neuron Networks in the Balanced State
• Intrinsically-generated fluctuating activity in excitatory-inhibitory networks
• Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks
• Path integral methods for the dynamics of stochastic and disordered systems
• Determination of the edge of criticality in echo state networks through Fisher information maximization
• Echoes in correlated neural systems
• Integration of continuous-time dynamics in a spiking neural network simulator

Cited by in corpus (35)

• Physical reservoir computing -- An introductory perspective
• Edge of chaos and avalanches in neural networks with heavy-tailed synaptic weight distribution
• Dimension of activity in random neural networks
• Contrasting the effects of adaptation and synaptic filtering on the timescales of dynamics in recurrent networks
• A Novel Antifragility Measure Based on Satisfaction and Its Application to Random and Biological Boolean Networks
• Optimal short-term memory before the edge of chaos in driven random recurrent networks
• Transient chaotic dimensionality expansion by recurrent networks
• Conditions for wave trains in spiking neural networks
• Gell-Mann-Low criticality in neural networks
• Firing rate homeostasis counteracts changes in stability of recurrent neural networks caused by synapse loss in Alzheimer's disease
• Unified field theoretical approach to deep and recurrent neuronal networks
• On the number of limit cycles in asymmetric neural networks
• Large Deviations Approach to Random Recurrent Neuronal Networks: Parameter Inference and Fluctuation-Induced Transitions
• Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks
• Self-consistent formulations for stochastic nonlinear neuronal dynamics
• Input correlations impede suppression of chaos and learning in balanced rate networks
• A Microscopic Theory of Intrinsic Timescales in Spiking Neural Networks
• Suppression of chaos in a partially driven recurrent neural network
• Spectrum of non-Hermitian deep-Hebbian neural networks
• Incorporating Heterogeneous Interactions for Ecological Biodiversity
• Dynamical Theory for Adaptive Systems
• An optimization-based equilibrium measure describes non-equilibrium steady state dynamics: application to edge of chaos
• Effect of Synaptic Heterogeneity on Neuronal Coordination
• Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks
• Double-replica theory for evolution of genotype-phenotype interrelationship
• Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks
• Discontinuous transition to chaos in a canonical random neural network
• Irreversibility in Non-reciprocal Chaotic Systems
• Dynamics and computation in mixed networks containing neurons that accelerate towards spiking
• Phase transitions in in vivo or in vitro populations of spiking neurons belong to different universality classes
• Hierarchy of chaotic dynamics in random modular networks
• Neuronal architecture extracts statistical temporal patterns
• Phase transitions from linear to nonlinear information processing in neural networks
• Statistics of correlations in nonlinear recurrent neural networks
• Memory Uncertainty Relation and Harmonic Memory in Random Recurrent Networks