Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding

Zi Yang, Samridhi Choudhary, Siegfried Kunzmann +1

Fine-tuned transformer models have shown superior performances in many natural language tasks. However, the large model size prohibits deploying high-performance transformer models…