MKQ-BERT: Quantized BERT with 4-bits Weights and Activations

Hanlin Tang, Xipeng Zhang, Kai Liu +2

Recently, pre-trained Transformer based language models, such as BERT, have shown great superiority over the traditional methods in many Natural Language Processing (NLP) tasks. Ho…