Mixed Precision of Quantization of Transformer Language Models for Speech Recognition

Junhao Xu, Shoukang Hu, Jianwei Yu +2

State-of-the-art neural language models represented by Transformers are becoming increasingly complex and expensive for practical applications. Low-bit deep neural network quantiza…