Curriculum Learning for Domain Adaptation in Neural Machine Translation
arXiv:1905.05816
Abstract
We introduce a curriculum learning approach to adapt generic neural machine translation models to a specific domain. Samples are grouped by their similarities to the domain of interest and each group is fed to the training algorithm with a particular schedule. This approach is simple to implement on top of any neural framework or architecture, and consistently outperforms both unadapted and adapted baselines in experiments with two distinct domains and two language pairs.
References in corpus (7)
- A Survey of Domain Adaptation for Neural Machine Translation
- Sockeye: A Toolkit for Neural Machine Translation
- Fast Domain Adaptation for Neural Machine Translation
- Curriculum Learning and Minibatch Bucketing in Neural Machine Translation
- An Empirical Exploration of Curriculum Learning for Neural Machine Translation
- Cynical Selection of Language Model Training Data
- Data Selection with Cluster-Based Language Difference Models and Cynical Selection