An Investigation on Different Underlying Quantization Schemes for Pre-trained Language Models

Zihan Zhao, Yuncong Liu, Lu Chen +3

Recently, pre-trained language models like BERT have shown promising performance on multiple natural language processing tasks. However, the application of these models has been li…