Searching for long time scales without fine tuning
arXiv:2008.11674
Abstract
Most of animal and human behavior occurs on time scales much longer than the response times of individual neurons. In many cases, it is plausible that these long time scales emerge from the recurrent dynamics of electrical activity in networks of neurons. In linear models, time scales are set by the eigenvalues of a dynamical matrix whose elements measure the strengths of synaptic connections between neurons. It is not clear to what extent these matrix elements need to be tuned in order to generate long time scales; in some cases, one needs not just a single long time scale but a whole range. Starting from the simplest case of random symmetric connections, we combine maximum entropy and random matrix theory methods to construct ensembles of networks, exploring the constraints required for long time scales to become generic. We argue that a single long time scale can emerge generically from realistic constraints, but a full spectrum of slow modes requires more tuning. Langevin dynamics that generates patterns of synaptic connections drawn from these ensembles involves a combination of Hebbian learning and activity-dependent synaptic scaling.
20 pages, 6 figures
References in corpus (9)
- Colloquium: Criticality and dynamical scaling in living systems
- Predictability and hierarchy in Drosophila behavior
- Large Deviations of Extreme Eigenvalues of Random Matrices
- Extreme Value Statistics of Eigenvalues of Gaussian Random Matrices
- Eigenvector statistics in non-Hermitian random matrix ensembles
- Marginally Stable Equilibria in Critical Ecosystems
- Eigenvalue statistics of the real Ginibre ensemble
- Statistical properties of eigenvectors in non-Hermitian Gaussian random matrix ensembles
- Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs