A balanced memory network

Abstract

A fundamental problem in neuroscience is understanding how working memory -- the ability to store information at intermediate timescales, like 10s of seconds -- is implemented in realistic neuronal networks. The most likely candidate mechanism is the attractor network, and a great deal of effort has gone toward investigating it theoretically. Yet, despite almost a quarter century of intense work, attractor networks are not fully understood. In particular, there are still two unanswered questions. First, how is it that attractor networks exhibit irregular firing, as is observed experimentally during working memory tasks? And second, how many memories can be stored under biologically realistic conditions? Here we answer both questions by studying an attractor neural network in which inhibition and excitation balance each other. Using mean field analysis, we derive a three-variable description of attractor networks. From this description it follows that irregular firing can exist only if the number of neurons involved in a memory is large. The same mean field analysis also shows that the number of memories that can be stored in a network scales with the number of excitatory connections, a result that has been suggested for simple models but never shown for realistic ones. Both of these predictions are verified using simulations with large networks of spiking neurons.

Accepted for publications in PLoS Comp. Biol

References in corpus (2)

• The storage capacity of Potts models for semantic memory retrieval
• An associative network with spatially organized connectivity

Cited by in corpus (21)

• Linking connectivity, dynamics and computations in low-rank recurrent neural networks
• Balanced Excitation and Inhibition are Required for High-Capacity, Noise-Robust Neuronal Selectivity
• Dynamics of random recurrent networks with correlated low-rank structure
• Balanced networks of spiking neurons with spatially dependent recurrent connections
• Observed network dynamics from altering the balance between excitatory and inhibitory neurons in cultured networks
• Robust short-term memory without synaptic learning
• Mechanisms underlying the response of mouse cortical networks to optogenetic manipulation
• Macroscopic Fluctuations Emerge in Balanced Networks with Incomplete Recurrent Alignment
• Predictive coding in balanced neural networks with noise, chaos and delays
• Clusters in nonsmooth oscillator networks
• Computational principles of biological memory
• Efficiency of local learning rules in threshold-linear associative networks
• Self-sustained activity, bursts, and variability in recurrent networks
• Firing Rate Models as Associative Memory: Excitatory-Inhibitory Balance for Robust Retrieval
• Interplay between Network Topology and Dynamics in Neural Systems
• Information capacity and transmission are maximized in balanced cortical networks with neuronal avalanches
• Non-equilibrium statistical mechanics of continuous attractors
• Benchmarking local Hebbian learning rules for memory storage and prototype extraction
• Network mechanisms of working memory: the role of neuronal nonlinearities
• Continuous parameter working memory in a balanced chaotic neural network
• Short-Term Memory Through Persistent Activity: Evolution of Self-Stopping and Self-Sustaining Activity in Spiking Neural Networks