Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition

Abstract

Artificial neural networks (ANN) have become the mainstream acoustic modeling technique for large vocabulary automatic speech recognition (ASR). A conventional ANN features a multi-layer architecture that requires massive amounts of computation. The brain-inspired spiking neural networks (SNN) closely mimic the biological neural networks and can operate on low-power neuromorphic hardware with spike-based computation. Motivated by their unprecedented energyefficiency and rapid information processing capability, we explore the use of SNNs for speech recognition. In this work, we use SNNs for acoustic modeling and evaluate their performance on several large vocabulary recognition scenarios. The experimental results demonstrate competitive ASR accuracies to their ANN counterparts, while require significantly reduced computational cost and inference time. Integrating the algorithmic power of deep SNNs with energy-efficient neuromorphic hardware, therefore, offer an attractive solution for ASR applications running locally on mobile and embedded devices.

arXiv commentSubmitted to Frontier of Neuroscience

References in corpus (13)

• Distilling the Knowledge in a Neural Network
• LSTM: A Search Space Odyssey
• Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
• Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
• Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
• DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
• Deep Learning in Spiking Neural Networks
• Light Gated Recurrent Units for Speech Recognition
• Surrogate Gradient Learning in Spiking Neural Networks
• Spiking Deep Residual Network
• A Spiking Network that Learns to Extract Spike Signatures from Speech Signals
• A Tandem Learning Rule for Effective Training and Rapid Inference of Deep Spiking Neural Networks
• An efficient and perceptually motivated auditory neural encoding and decoding algorithm for spiking neural networks