Highly Efficient 8-bit Low Precision Inference of Convolutional Neural Networks with IntelCaffe

Jiong Gong, Haihao Shen, Guoming Zhang +6

High throughput and low latency inference of deep neural networks are critical for the deployment of deep learning applications. This paper presents the efficient inference techniq…