Learning Accurate Integer Transformer Machine-Translation Models

Ephrem Wu

We describe a method for training accurate Transformer machine-translation models to run inference using 8-bit integer (INT8) hardware matrix multipliers, as opposed to the more co…