Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rules

Abstract

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.

References in corpus (2)

• Equilibrium Properties of Temporally Asymmetric Hebbian Plasticity
• Multi-contact synapses for stable networks: a spike-timing dependent model of dendritic spine plasticity and turnover

Cited by in corpus (20)

• Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligence
• A taxonomy of surprise definitions
• One-shot learning and behavioral eligibility traces in sequential decision making
• Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networks
• ETLP: Event-based Three-factor Local Plasticity for online learning with neuromorphic hardware
• Multiplexed gradient descent: Fast online training of modern datasets on hardware neural networks without backpropagation
• SpikePropamine: Differentiable Plasticity in Spiking Neural Networks
• Emergent Computations in Trained Artificial Neural Networks and Real Brains
• Solving large-scale MEG/EEG source localization and functional connectivity problems simultaneously using state-space models
• Associative memory model with arbitrary Hebbian length
• Benchmarking Spiking Neural Network Learning Methods with Varying Locality
• Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
• Learning with Delayed Synaptic Plasticity
• Eigenvalue spectrum of neural networks with arbitrary Hebbian length
• Novelty Producing Synaptic Plasticity
• Scaling of hardware-compatible perturbative training algorithms
• Computational models of learning and synaptic plasticity
• 2022 Roadmap on Neuromorphic Computing and Engineering
• TESS: A Scalable Temporally and Spatially Local Learning Rule for Spiking Neural Networks
• Three factor delay learning rules for spiking neural networks