Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition

Hong Liu, Zhaobiao Lv, Zhijian Ou +2

Energy-based language models (ELMs) parameterize an unnormalized distribution for natural sentences and are radically different from popular autoregressive language models (ALMs).…