Using Firing-Rate Dynamics to Train Recurrent Networks of Spiking Model Neurons

Abstract

Recurrent neural networks are powerful tools for understanding and modeling computation and representation by populations of neurons. Continuous-variable or "rate" model networks have been analyzed and applied extensively for these purposes. However, neurons fire action potentials, and the discrete nature of spiking is an important feature of neural circuit dynamics. Despite significant advances, training recurrently connected spiking neural networks remains a challenge. We present a procedure for training recurrently connected spiking networks to generate dynamical patterns autonomously, to produce complex temporal outputs based on integrating network input, and to model physiological data. Our procedure makes use of a continuous-variable network to identify targets for training the inputs to the spiking model neurons. Surprisingly, we are able to construct spiking networks that duplicate tasks performed by continuous-variable networks with only a relatively minor expansion in the number of neurons. Our approach provides a novel view of the significance and appropriate use of "firing rate" models, and it is a useful approach for building model spiking networks that can be used to address important questions about representation and computation in neural systems.

arXiv comment17 pages, 6 figures

References in corpus (3)

• Complexity without chaos: Plasticity within random recurrent networks generates robust timing and motor control
• Stimulus-Dependent Suppression of Chaos in Recurrent Neural Networks
• Learning universal computations with spikes

Cited by in corpus (8)

• Supervised Learning in Spiking Neural Networks with FORCE Training
• Learning universal computations with spikes
• Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network
• Training dynamically balanced excitatory-inhibitory networks
• Gridbot: An autonomous robot controlled by a Spiking Neural Network mimicking the brain's navigational system
• Emergent Computations in Trained Artificial Neural Networks and Real Brains
• From statistical inference to a differential learning rule for stochastic neural networks
• Learning recurrent dynamics in spiking networks