Towards one-shot learning for rare-word translation with external experts
arXiv:1809.03182
Abstract
Neural machine translation (NMT) has significantly improved the quality of automatic translation models. One of the main challenges in current systems is the translation of rare words. We present a generic approach to address this weakness by having external models annotate the training data as Experts, and control the model-expert interaction with a pointer network and reinforcement learning. Our experiments using phrase-based models to simulate Experts to complement neural machine translation models show that the model can be trained to copy the annotations into the output consistently. We demonstrate the benefit of our proposed framework in outof-domain translation scenarios with only lexical resources, improving more than 1.0 BLEU point in both translation directions English to Spanish and German to English
arXiv comment2nd Workshop on Neural Machine Translation and Generation, ACL 2018
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- Neural Machine Translation by Jointly Learning to Align and Translate
- Sequence to Sequence Learning with Neural Networks
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- A Deep Reinforced Model for Abstractive Summarization
- Sequence Level Training with Recurrent Neural Networks
- An Actor-Critic Algorithm for Sequence Prediction
- Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling
- Modeling Coverage for Neural Machine Translation
- Reinforcement Learning Neural Turing Machines - Revised
- Addressing the Rare Word Problem in Neural Machine Translation
- Pre-Translation for Neural Machine Translation
- Minimum Risk Training for Neural Machine Translation