Future-Prediction-Based Model for Neural Machine Translation
arXiv:1809.00336
Abstract
We propose a novel model for Neural Machine Translation (NMT). Different from the conventional method, our model can predict the future text length and words at each decoding time step so that the generation can be helped with the information from the future prediction. With such information, the model does not stop generation without having translated enough content. Experimental results demonstrate that our model can significantly outperform the baseline models. Besides, our analysis reflects that our model is effective in the prediction of the length and words of the untranslated content.
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Neural Machine Translation by Jointly Learning to Align and Translate
- Sequence to Sequence Learning with Neural Networks
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Effective Approaches to Attention-based Neural Machine Translation
- Neural Machine Translation in Linear Time
- Modeling Coverage for Neural Machine Translation
- Coverage Embedding Models for Neural Machine Translation
- Supervised Attentions for Neural Machine Translation
- Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation