Quantized Neural Network Inference with Precision Batching

Maximilian Lam, Zachary Yedidia, Colby Banbury +1

We present PrecisionBatching, a quantized inference algorithm for speeding up neural network execution on traditional hardware platforms at low bitwidths without the need for retra…