SQuAT: Sharpness- and Quantization-Aware Training for BERT

Zheng Wang, Juncheng B Li, Shuhui Qu +2

Quantization is an effective technique to reduce memory footprint, inference latency, and power consumption of deep learning models. However, existing quantization methods suffer f…