An Overview of Datatype Quantization Techniques for Convolutional Neural Networks

Abstract

Convolutional Neural Networks (CNNs) are becoming increasingly popular due to their superior performance in the domain of computer vision, in applications such as objection detection and recognition. However, they demand complex, power-consuming hardware which makes them unsuitable for implementation on low-power mobile and embedded devices. In this paper, a description and comparison of various techniques is presented which aim to mitigate this problem. This is primarily achieved by quantizing the floating-point weights and activations to reduce the hardware requirements, and adapting the training and inference algorithms to maintain the network's performance.

arXiv comment4 pages, 2 figures

References in corpus (8)

• Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
• BinaryConnect: Training Deep Neural Networks with binary weights during propagations
• Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
• Ternary Weight Networks
• Fixed Point Quantization of Deep Convolutional Networks
• Compressing Neural Networks with the Hashing Trick
• Two-Bit Networks for Deep Learning on Resource-Constrained Embedded Devices
• Fixed-point optimization of deep neural networks with adaptive step size retraining