Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networks

Abstract

$\text{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in neuromorphic artificial intelligence. Despite extensive research on spiking neural networks (SNNs), most studies are established on deterministic models, overlooking the inherent non-deterministic, noisy nature of neural computations. This study introduces the noisy spiking neural network (NSNN) and the noise-driven learning rule (NDL) by incorporating noisy neuronal dynamics to exploit the computational advantages of noisy neural processing. NSNN provides a theoretical framework that yields scalable, flexible, and reliable computation. We demonstrate that NSNN leads to spiking neural models with competitive performance, improved robustness against challenging perturbations than deterministic SNNs, and better reproducing probabilistic computations in neural coding. This study offers a powerful and easy-to-use tool for machine learning, neuromorphic intelligence practitioners, and computational neuroscience researchers.

arXiv comment36 pages, 9 figures, 4 tables. Formal version available at https://cell.com/patterns/fulltext/S2666-3899(23)00200-3

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Improving neural networks by preventing co-adaptation of feature detectors
• Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks
• Memory and information processing in neuromorphic systems
• SuperSpike: Supervised learning in multi-layer spiking neural networks
• Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rules
• Gradient learning in spiking neural networks by dynamic perturbation of conductances
• An Introduction to Probabilistic Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applications
• Kernel methods on spike train space for neuroscience: a tutorial
• Neural system identification for large populations separating "what" and "where"
• Explicit Regularisation in Gaussian Noise Injections
• Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction
• Rescuing neural spike train models from bad MLE

Cited by in corpus (1)

• Understanding the Functional Roles of Modelling Components in Spiking Neural Networks