Optimal Quantization for Batch Normalization in Neural Network Deployments and Beyond

Dachao Lin, Peiqin Sun, Guangzeng Xie +2

Quantized Neural Networks (QNNs) use low bit-width fixed-point numbers for representing weight parameters and activations, and are often used in real-world applications due to thei…