21 citations · 44 across the 9 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CL2019★ 10 cited
Speech-XLNet: Unsupervised Acoustic Model Pretraining For Self-Attention Networks
Xingchen Song, Guangsen Wang, Zhiyong Wu +4
Self-attention network (SAN) can benefit significantly from the bi-directional representation learning through unsupervised pretraining paradigms such as BERT and XLNet. In this pa…
cs.CL2019
Phrase-Level Class based Language Model for Mandarin Smart Speaker Query Recognition
Yiheng Huang, Liqiang He, Lei Han +2
The success of speech assistants requires precise recognition of a number of entities on particular contexts. A common solution is to train a class-based n-gram language model and…
cs.CL2019
A Random Gossip BMUF Process for Neural Language Modeling
Yiheng Huang, Jinchuan Tian, Lei Han +4
Neural network language model (NNLM) is an essential component of industrial ASR systems. One important challenge of training an NNLM is to leverage between scaling the learning pr…