Low-bit Quantization of Neural Networks for Efficient Inference

Yoni Choukroun, Eli Kravchik, Fan Yang +1

Recent machine learning methods use increasingly large deep neural networks to achieve state of the art results in various tasks. The gains in performance come at the cost of a sub…