An Empirical Comparison of Simple Domain Adaptation Methods for Neural Machine Translation

Abstract

In this paper, we propose a novel domain adaptation method named "mixed fine tuning" for neural machine translation (NMT). We combine two existing approaches namely fine tuning and multi domain NMT. We first train an NMT model on an out-of-domain parallel corpus, and then fine tune it on a parallel corpus which is a mix of the in-domain and out-of-domain corpora. All corpora are augmented with artificial tags to indicate specific domains. We empirically compare our proposed method against fine tuning and multi domain methods and discuss its benefits and shortcomings.

6 pages

References in corpus (3)

• Sequence to Sequence Learning with Neural Networks
• Fast Domain Adaptation for Neural Machine Translation
• Domain specialization: a post-training domain adaptation for Neural Machine Translation

Cited by in corpus (5)

• Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation
• Robust Machine Translation with Domain Sensitive Pseudo-Sources: Baidu-OSU WMT19 MT Robustness Shared Task System Report
• Domain Adaptation of NMT models for English-Hindi Machine Translation Task at AdapMT ICON 2020
• Investigating Catastrophic Forgetting During Continual Training for Neural Machine Translation
• Don't Go Far Off: An Empirical Study on Neural Poetry Translation