Phrase Table as Recommendation Memory for Neural Machine Translation
arXiv:1805.09960
Abstract
Neural Machine Translation (NMT) has drawn much attention due to its promising translation performance recently. However, several studies indicate that NMT often generates fluent but unfaithful translations. In this paper, we propose a method to alleviate this problem by using a phrase table as recommendation memory. The main idea is to add bonus to words worthy of recommendation, so that NMT can make correct predictions. Specifically, we first derive a prefix tree to accommodate all the candidate target phrases by searching the phrase translation table according to the source sentence. Then, we construct a recommendation word set by matching between candidate target phrases and previously translated target words by NMT. After that, we determine the specific bonus value for each recommendable word by using the attention vector and phrase translation probability. Finally, we integrate this bonus value into NMT to improve the translation results. The extensive experiments demonstrate that the proposed methods obtain remarkable improvements over the strong attentionbased NMT.
arXiv commentaccepted by IJCAI 2018
References in corpus (10)
- Sequence to Sequence Learning with Neural Networks
- Is Neural Machine Translation Ready for Deployment? A Case Study on 30 Translation Directions
- Syntactically Guided Neural Machine Translation
- Neural Machine Translation with External Phrase Memory
- Bridging Neural Machine Translation and Bilingual Dictionaries
- Implicit Distortion and Fertility Models for Attention-based Encoder-Decoder NMT Model
- Incorporating Discrete Translation Lexicons into Neural Machine Translation
- Supervised Attentions for Neural Machine Translation
- Memory-augmented Neural Machine Translation
- Translating Phrases in Neural Machine Translation