BoolNet: Minimizing The Energy Consumption of Binary Neural Networks

Abstract

Recent works on Binary Neural Networks (BNNs) have made promising progress in narrowing the accuracy gap of BNNs to their 32-bit counterparts. However, the accuracy gains are often based on specialized model designs using additional 32-bit components. Furthermore, almost all previous BNNs use 32-bit for feature maps and the shortcuts enclosing the corresponding binary convolution blocks, which helps to effectively maintain the accuracy, but is not friendly to hardware accelerators with limited memory, energy, and computing resources. Thus, we raise the following question: How can accuracy and energy consumption be balanced in a BNN network design? We extensively study this fundamental problem in this work and propose a novel BNN architecture without most commonly used 32-bit components: \textit{BoolNet}. Experimental results on ImageNet demonstrate that BoolNet can achieve 4.6x energy reduction coupled with 1.2\% higher accuracy than the commonly used BNN architecture Bi-RealNet. Code and trained models are available at: https://github.com/hpi-xnor/BoolNet.

References in corpus (14)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
• Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
• DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
• Binarized Neural Networks
• On the Variance of the Adaptive Learning Rate and Beyond
• GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing
• Carbon Emissions and Large Neural Network Training
• Moonshine: Distilling with Cheap Convolutions
• MeliusNet: Can Binary Neural Networks Achieve MobileNet-level Accuracy?
• Training Binary Neural Networks with Real-to-Binary Convolutions
• Funnel Activation for Visual Recognition
• BARS: Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures