Sleep-like slow oscillations improve visual classification through synaptic homeostasis and memory association in a thalamo-cortical model

Abstract

The occurrence of sleep passed through the evolutionary sieve and is widespread in animal species. Sleep is known to be beneficial to cognitive and mnemonic tasks, while chronic sleep deprivation is detrimental. Despite the importance of the phenomenon, a complete understanding of its functions and underlying mechanisms is still lacking. In this paper, we show interesting effects of deep-sleep-like slow oscillation activity on a simplified thalamo-cortical model which is trained to encode, retrieve and classify images of handwritten digits. During slow oscillations, spike-timing-dependent-plasticity (STDP) produces a differential homeostatic process. It is characterized by both a specific unsupervised enhancement of connections among groups of neurons associated to instances of the same class (digit) and a simultaneous down-regulation of stronger synapses created by the training. This hierarchical organization of post-sleep internal representations favours higher performances in retrieval and classification tasks. The mechanism is based on the interaction between top-down cortico-thalamic predictions and bottom-up thalamo-cortical projections during deep-sleep-like slow oscillations. Indeed, when learned patterns are replayed during sleep, cortico-thalamo-cortical connections favour the activation of other neurons coding for similar thalamic inputs, promoting their association. Such mechanism hints at possible applications to artificial learning systems.

arXiv comment11 pages, 5 figures, v5 is the final version published on Scientific Reports journal

References in corpus (3)

• Self-sustained asynchronous irregular states and Up/Down states in thalamic, cortical and thalamocortical networks of nonlinear integrate-and-fire neurons
• Supervised Learning in Spiking Neural Networks with FORCE Training
• Gaussian and exponential lateral connectivity on distributed spiking neural network simulation

Cited by in corpus (11)

• Beyond spiking networks: the computational advantages of dendritic amplification and input segregation
• Comparing apples to apples -- Using a modular and adaptable analysis pipeline to compare slow cerebral rhythms across heterogeneous datasets
• Thalamo-cortical spiking model of incremental learning combining perception, context and NREM-sleep-mediated noise-resilience
• Cortical oscillations implement a backbone for sampling-based computation in spiking neural networks
• Simulations Approaching Data: Cortical Slow Waves in Inferred Models of the Whole Hemisphere of Mouse
• Slow Waves Analysis Pipeline for extracting the Features of the Bi-Modality from the Cerebral Cortex of Anesthetized Mice
• Scaling of a large-scale simulation of synchronous slow-wave and asynchronous awake-like activity of a cortical model with long-range interconnections
• Target spiking patterns enable efficient and biologically plausible learning for complex temporal tasks
• Analysis and Model of Cortical Slow Waves Acquired with Optical Techniques
• Computational role of sleep in memory reorganization
• Error-based or target-based? A unifying framework for learning in recurrent spiking networks