Empirical Evaluation of Post-Training Quantization Methods for Language Tasks

Ting Hu, Christoph Meinel, Haojin Yang

Transformer-based architectures like BERT have achieved great success in a wide range of Natural Language tasks. Despite their decent performance, the models still have numerous pa…