OverQ: Opportunistic Outlier Quantization for Neural Network Accelerators

Ritchie Zhao, Jordan Dotzel, Zhanqiu Hu +3

Outliers in weights and activations pose a key challenge for fixed-point quantization of neural networks. While they can be addressed by fine-tuning, this is not practical for ML s…