Building a Neural Machine Translation System Using Only Synthetic Parallel Data
arXiv:1704.00253
Abstract
Recent works have shown that synthetic parallel data automatically generated by translation models can be effective for various neural machine translation (NMT) issues. In this study, we build NMT systems using only synthetic parallel data. As an efficient alternative to real parallel data, we also present a new type of synthetic parallel corpus. The proposed pseudo parallel data are distinct from previous works in that ground truth and synthetic examples are mixed on both sides of sentence pairs. Experiments on Czech-German and French-German translations demonstrate the efficacy of the proposed pseudo parallel corpus, which shows not only enhanced results for bidirectional translation tasks but also substantial improvement with the aid of a ground truth real parallel corpus.
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Sequence to Sequence Learning with Neural Networks
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- How to Construct Deep Recurrent Neural Networks
- Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation
- Bridging Neural Machine Translation and Bilingual Dictionaries
- Zero-Resource Translation with Multi-Lingual Neural Machine Translation
- Neural Machine Translation with Pivot Languages