Ultra-compact Binary Neural Networks for Human Activity Recognition on RISC-V Processors

Abstract

Human Activity Recognition (HAR) is a relevant inference task in many mobile applications. State-of-the-art HAR at the edge is typically achieved with lightweight machine learning models such as decision trees and Random Forests (RFs), whereas deep learning is less common due to its high computational complexity. In this work, we propose a novel implementation of HAR based on deep neural networks, and precisely on Binary Neural Networks (BNNs), targeting low-power general purpose processors with a RISC-V instruction set. BNNs yield very small memory footprints and low inference complexity, thanks to the replacement of arithmetic operations with bit-wise ones. However, existing BNN implementations on general purpose processors impose constraints tailored to complex computer vision tasks, which result in over-parametrized models for simpler problems like HAR. Therefore, we also introduce a new BNN inference library, which targets ultra-compact models explicitly. With experiments on a single-core RISC-V processor, we show that BNNs trained on two HAR datasets obtain higher classification accuracy compared to a state-of-the-art baseline based on RFs. Furthermore, our BNN reaches the same accuracy of a RF with either less memory (up to 91%) or more energy-efficiency (up to 70%), depending on the complexity of the features extracted by the RF.

arXiv commentPublished in: 2021 18th ACM International Conference on Computing Frontiers (CF)

References in corpus (6)

• Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
• Deep Learning with Limited Numerical Precision
• Binarized Neural Networks
• Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables
• XNOR Neural Engine: a Hardware Accelerator IP for 21.6 fJ/op Binary Neural Network Inference
• BMXNet: An Open-Source Binary Neural Network Implementation Based on MXNet

Cited by in corpus (3)

• Human Activity Recognition on Microcontrollers with Quantized and Adaptive Deep Neural Networks
• Dynamic Decision Tree Ensembles for Energy-Efficient Inference on IoT Edge Nodes
• Channel-wise Mixed-precision Assignment for DNN Inference on Constrained Edge Nodes