Integrating Discrete and Neural Features via Mixed-feature Trans-dimensional Random Field Language Models

Silin Gao, Zhijian Ou, Wei Yang +1

There has been a long recognition that discrete features (n-gram features) and neural network based features have complementary strengths for language models (LMs). Improved perfor…