Lightweight Adaptive Mixture of Neural and N-gram Language Models

Anton Bakhtin, Arthur Szlam, Marc'Aurelio Ranzato +1

It is often the case that the best performing language model is an ensemble of a neural language model with n-grams. In this work, we propose a method to improve how these two mode…