Cortical oscillations implement a backbone for sampling-based computation in spiking neural networks

Abstract

Being permanently confronted with an uncertain world, brains have faced evolutionary pressure to represent this uncertainty in order to respond appropriately. Often, this requires visiting multiple interpretations of the available information or multiple solutions to an encountered problem. This gives rise to the so-called mixing problem: since all of these "valid" states represent powerful attractors, but between themselves can be very dissimilar, switching between such states can be difficult. We propose that cortical oscillations can be effectively used to overcome this challenge. By acting as an effective temperature, background spiking activity modulates exploration. Rhythmic changes induced by cortical oscillations can then be interpreted as a form of simulated tempering. We provide a rigorous mathematical discussion of this link and study some of its phenomenological implications in computer simulations. This identifies a new computational role of cortical oscillations and connects them to various phenomena in the brain, such as sampling-based probabilistic inference, memory replay, multisensory cue combination, and place cell flickering.

arXiv comment34 pages, 9 figures

References in corpus (9)

• Simulated Tempering: A New Monte Carlo Scheme
• Dynamic Balance of Excitation and Inhibition in Human and Monkey Neocortex
• Self-sustained asynchronous irregular states and Up/Down states in thalamic, cortical and thalamocortical networks of nonlinear integrate-and-fire neurons
• Stochastic inference with spiking neurons in the high-conductance state
• Accelerated physical emulation of Bayesian inference in spiking neural networks
• Sleep-like slow oscillations improve visual classification through synaptic homeostasis and memory association in a thalamo-cortical model
• Stochasticity from function -- why the Bayesian brain may need no noise
• Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons
• The thermodynamic temperature of a rhythmic spiking network

Cited by in corpus (3)

• Dendritic predictive coding: A theory of cortical computation with spiking neurons
• Efficient Deep Spiking Multi-Layer Perceptrons with Multiplication-Free Inference
• Ultrafast neural sampling with spiking nanolasers