Dynamics of random recurrent networks with correlated low-rank structure

Abstract

A given neural network in the brain is involved in many different tasks. This implies that, when considering a specific task, the network's connectivity contains a component which is related to the task and another component which can be considered random. Understanding the interplay between the structured and random components, and their effect on network dynamics and functionality is an important open question. Recent studies addressed the co-existence of random and structured connectivity, but considered the two parts to be uncorrelated. This constraint limits the dynamics and leaves the random connectivity non-functional. Algorithms that train networks to perform specific tasks typically generate correlations between structure and random connectivity. Here we study nonlinear networks with correlated structured and random components, assuming the structure to have a low rank. We develop an analytic framework to establish the precise effect of the correlations on the eigenvalue spectrum of the joint connectivity. We find that the spectrum consists of a bulk and multiple outliers, whose location is predicted by our theory. Using mean-field theory, we show that these outliers directly determine both the fixed points of the system and their stability. Taken together, our analysis elucidates how correlations allow structured and random connectivity to synergistically extend the range of computations available to networks.

arXiv comment18 pages, 7 figures

References in corpus (10)

• Linking connectivity, dynamics and computations in low-rank recurrent neural networks
• Stimulus-Dependent Suppression of Chaos in Recurrent Neural Networks
• Transition to chaos in random networks with cell-type-specific connectivity
• Topological and Dynamical Complexity of Random Neural Networks
• A balanced memory network
• Local Dynamics in Trained Recurrent Neural Networks
• Formation of Dominant Mode by Evolution in Biological Systems
• Spectral Theory of Sparse Non-Hermitian Random Matrices
• Spectra of sparse non-Hermitian random matrices: an analytical solution
• Eigenvalue Outliers of non-Hermitian Random Matrices with a Local Tree Structure

Cited by in corpus (14)

• The Geometry of Information Coding in Correlated Neural Populations
• Quality of internal representation shapes learning performance in feedback neural networks
• Macroscopic Fluctuations Emerge in Balanced Networks with Incomplete Recurrent Alignment
• The spectral density of dense random networks and the breakdown of the Wigner semicircle law
• Slow manifolds in recurrent networks encode working memory efficiently and robustly
• Introduction to dynamical mean-field theory of randomly connected neural networks with bidirectionally correlated couplings
• Volcano transition in populations of phase oscillators with random nonreciprocal interactions
• Irreversibility in Non-reciprocal Chaotic Systems
• Evaluating the statistical similarity of neural network activity and connectivity via eigenvector angles
• Analytic approach for the number statistics of non-Hermitian random matrices
• Synaptic plasticity alters the nature of chaos transition in neural networks
• Bifurcations of a neural network model with symmetry
• Comparing Dynamical Models Through Diffeomorphic Vector Field Alignment
• Mean-field theory of vector spin models on networks with arbitrary degree distributions