Spectrum of non-Hermitian deep-Hebbian neural networks

Abstract

Neural networks with recurrent asymmetric couplings are important to understand how episodic memories are encoded in the brain. Here, we integrate the experimental observation of wide synaptic integration window into our model of sequence retrieval in the continuous time dynamics. The model with non-normal neuron-interactions is theoretically studied by deriving a random matrix theory of the Jacobian matrix in neural dynamics. The spectra bears several distinct features, such as breaking rotational symmetry about the origin, and the emergence of nested voids within the spectrum boundary. The spectral density is thus highly non-uniformly distributed in the complex plane. The random matrix theory also predicts a transition to chaos. In particular, the edge of chaos provides computational benefits for the sequential retrieval of memories. Our work provides a systematic study of time-lagged correlations with arbitrary time delays, and thus can inspire future studies of a broad class of memory models, and even big data analysis of biological time series.

arXiv comment65 pages, 12 figures, revised version for publication

References in corpus (16)

• Recurrent Network Models Of Sequence Generation And Memory
• Eigenvector statistics in non-Hermitian random matrix ensembles
• Non-Gaussian Non-Hermitean Random Matrix Theory: phase transitions and addition formalism
• Topological and Dynamical Complexity of Random Neural Networks
• Signal and Noise in Correlation Matrix
• Optimal sequence memory in driven random networks
• Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks
• Correlations of Eigenvectors for Non-Hermitian Random-Matrix Models
• Phase Diagram and Storage Capacity of Sequence Processing Neural Networks
• Dispersal-induced instability in complex ecosystems
• Squared eigenvalue condition numbers and eigenvector correlations from the single ring theorem
• "Single Ring Theorem" and the Disk-Annulus Phase Transition
• Multiplication law and S transform for non-hermitian random matrices
• Spectra of large time-lagged correlation matrices from Random Matrix Theory
• Associative memory model with arbitrary Hebbian length
• Eigenvalue spectrum of neural networks with arbitrary Hebbian length

Cited by in corpus (6)

• Introduction to dynamical mean-field theory of randomly connected neural networks with bidirectionally correlated couplings
• An optimization-based equilibrium measure describes non-equilibrium steady state dynamics: application to edge of chaos
• Freezing chaos without synaptic plasticity
• Synaptic plasticity alters the nature of chaos transition in neural networks
• Network reconstruction may not mean dynamics prediction
• Spiking mode-based neural networks