An Introduction to Probabilistic Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applications

Abstract

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking inputs and the corresponding event-driven nature of neural processing can be leveraged by energy-efficient hardware implementations, which can offer significant energy reductions as compared to conventional artificial neural networks (ANNs). The design of training algorithms lags behind the hardware implementations. Most existing training algorithms for SNNs have been designed either for biological plausibility or through conversion from pretrained ANNs via rate encoding. This article provides an introduction to SNNs by focusing on a probabilistic signal processing methodology that enables the direct derivation of learning rules by leveraging the unique time-encoding capabilities of SNNs. We adopt discrete-time probabilistic models for networked spiking neurons and derive supervised and unsupervised learning rules from first principles via variational inference. Examples and open research problems are also provided.

arXiv commentPublished in IEEE Signal Processing Magazine, Vol. 36, No. 6, pp. 64-77 (subsumes arXiv:1812.03929), Author's Accepted Manuscript

References in corpus (4)

• Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks
• Network Plasticity as Bayesian Inference
• Encoding Spike Patterns in Multilayer Spiking Neural Networks
• Learning First-to-Spike Policies for Neuromorphic Control Using Policy Gradients

Cited by in corpus (6)

• The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks
• A Survey on Collaborative DNN Inference for Edge Intelligence
• Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networks
• Antiferromagnet-Based Neuromorphics Using Dynamics of Topological Charges
• Neuromorphic Event-Driven Semantic Communication in Microgrids
• Bayesian Inference on Binary Spiking Networks Leveraging Nanoscale Device Stochasticity