Improving Neural Machine Translation by Denoising Training

Liang Ding, Keqin Peng, Dacheng Tao

We present a simple and effective pretraining strategy {D}en{o}ising {T}raining DoT for neural machine translation. Specifically, we update the model parameters with source- and ta…