Exploiting Neuron and Synapse Filter Dynamics in Spatial Temporal Learning of Deep Spiking Neural Network

Abstract

The recent discovered spatial-temporal information processing capability of bio-inspired Spiking neural networks (SNN) has enabled some interesting models and applications. However designing large-scale and high-performance model is yet a challenge due to the lack of robust training algorithms. A bio-plausible SNN model with spatial-temporal property is a complex dynamic system. Each synapse and neuron behave as filters capable of preserving temporal information. As such neuron dynamics and filter effects are ignored in existing training algorithms, the SNN downgrades into a memoryless system and loses the ability of temporal signal processing. Furthermore, spike timing plays an important role in information representation, but conventional rate-based spike coding models only consider spike trains statistically, and discard information carried by its temporal structures. To address the above issues, and exploit the temporal dynamics of SNNs, we formulate SNN as a network of infinite impulse response (IIR) filters with neuron nonlinearity. We proposed a training algorithm that is capable to learn spatial-temporal patterns by searching for the optimal synapse filter kernels and weights. The proposed model and training algorithm are applied to construct associative memories and classifiers for synthetic and public datasets including MNIST, NMNIST, DVS 128 etc.; and their accuracy outperforms state-of-art approaches.

References in corpus (8)

• Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks
• SLAYER: Spike Layer Error Reassignment in Time
• Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)
• Surrogate Gradient Learning in Spiking Neural Networks
• Direct Training for Spiking Neural Networks: Faster, Larger, Better
• Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networks
• Embodied Neuromorphic Vision with Event-Driven Random Backpropagation
• Neural Population Coding for Effective Temporal Classification

Cited by in corpus (4)

• STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networks
• Combining Spiking Neural Network and Artificial Neural Network for Enhanced Image Classification
• Ensembles of Spiking Neural Networks
• Multivariate Time Series Classification Using Spiking Neural Networks