Towards Fully 8-bit Integer Inference for the Transformer Model

Ye Lin, Yanyang Li, Tengbo Liu +3

8-bit integer inference, as a promising direction in reducing both the latency and storage of deep neural networks, has made great progress recently. On the other hand, previous sy…