Improving N-gram Language Models with Pre-trained Deep Transformer

Yiren Wang, Hongzhao Huang, Zhe Liu +4

Although n-gram language models (LMs) have been outperformed by the state-of-the-art neural LMs, they are still widely used in speech recognition due to its high efficiency in infe…