Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task
arXiv:2111.02086
Abstract
This report describes Microsoft's machine translation systems for the WMT21 shared task on large-scale multilingual machine translation. We participated in all three evaluation tracks including Large Track and two Small Tracks where the former one is unconstrained and the latter two are fully constrained. Our model submissions to the shared task were initialized with DeltaLM\footnote{\url{https://aka.ms/deltalm}}, a generic pre-trained multilingual encoder-decoder model, and fine-tuned correspondingly with the vast collected parallel data and allowed data sources according to track settings, together with applying progressive learning and iterative back-translation approaches to further improve the performance. Our final submissions ranked first on three tracks in terms of the automatic evaluation metric.
WMT21
References in corpus (6)
- Multilingual Denoising Pre-training for Neural Machine Translation
- Beyond English-Centric Multilingual Machine Translation
- Multilingual Neural Machine Translation with Knowledge Distillation
- Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation
- Learning with Feature-Dependent Label Noise: A Progressive Approach
- Adaptive Sparse Transformer for Multilingual Translation