Benchmarking Deep Spiking Neural Networks on Neuromorphic Hardware

Abstract

With more and more event-based neuromorphic hardware systems being developed at universities and in industry, there is a growing need for assessing their performance with domain specific measures. In this work, we use the methodology of converting pre-trained non-spiking to spiking neural networks to evaluate the performance loss and measure the energy-per-inference for three neuromorphic hardware systems (BrainScaleS, Spikey, SpiNNaker) and common simulation frameworks for CPU (NEST) and CPU/GPU (GeNN). For analog hardware we further apply a re-training technique known as hardware-in-the-loop training to cope with device mismatch. This analysis is performed for five different networks, including three networks that have been found by an automated optimization with a neural architecture search framework. We demonstrate that the conversion loss is usually below one percent for digital implementations, and moderately higher for analog systems with the benefit of much lower energy-per-inference costs.

arXiv commentThe final authenticated publication is available at Springer via https://doi.org/10.1007/978-3-030-61616-8_49

References in corpus (5)

• A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)
• Six networks on a universal neuromorphic computing substrate
• Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System
• Real-Time Cortical Simulation on Neuromorphic Hardware
• Characterization and Compensation of Network-Level Anomalies in Mixed-Signal Neuromorphic Modeling Platforms