Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling

Shruti Bhosale, Kyra Yee, Sergey Edunov +1

Pre-training models on vast quantities of unlabeled data has emerged as an effective approach to improving accuracy on many NLP tasks. On the other hand, traditional machine transl…