FP8-BERT: Post-Training Quantization for Transformer

Jianwei Li, Tianchi Zhang, Ian En-Hsu Yen +1

Transformer-based models, such as BERT, have been widely applied in a wide range of natural language processing tasks. However, one inevitable side effect is that they require mass…