Universal Conditional Masked Language Pre-training for Neural Machine Translation

Pengfei Li, Liangyou Li, Meng Zhang +2

Pre-trained sequence-to-sequence models have significantly improved Neural Machine Translation (NMT). Different from prior works where pre-trained models usually adopt an unidirect…