A Brief Survey of Multilingual Neural Machine Translation
arXiv:1905.05395
Abstract
We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising and interesting than its statistical machine translation counterpart because end-to-end modeling and distributed representations open new avenues. Many approaches have been proposed in order to exploit multilingual parallel corpora for improving translation quality. However, the lack of a comprehensive survey makes it difficult to determine which approaches are promising and hence deserve further exploration. In this paper, we present an in-depth survey of existing literature on MNMT. We categorize various approaches based on the resource scenarios as well as underlying modeling principles. We hope this paper will serve as a starting point for researchers and engineers interested in MNMT.
arXiv commentWe have substantially expanded this paper for a journal submission to computing surveys [arXiv:2001.01115]
References in corpus (25)
- Sequence to Sequence Learning with Neural Networks
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Convolutional Sequence to Sequence Learning
- Exploiting Similarities among Languages for Machine Translation
- An Autoencoder Approach to Learning Bilingual Word Representations
- Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder
- A Survey of Domain Adaptation for Neural Machine Translation
- Multilingual Neural Machine Translation with Knowledge Distillation
- Neural Machine Translation and Sequence-to-sequence Models: A Tutorial
- Transfer Learning across Low-Resource, Related Languages for Neural Machine Translation
- A Teacher-Student Framework for Zero-Resource Neural Machine Translation
- The Missing Ingredient in Zero-Shot Neural Machine Translation
- A Comparison of Transformer and Recurrent Neural Networks on Multilingual Neural Machine Translation
- Multilingual Neural Machine Translation with Task-Specific Attention
- Multilingual Neural Machine Translation With Soft Decoupled Encoding
- Effective Strategies in Zero-Shot Neural Machine Translation
- Improving Zero-Shot Translation of Low-Resource Languages
- Multilingual NMT with a language-independent attention bridge
- Enabling Multi-Source Neural Machine Translation By Concatenating Source Sentences In Multiple Languages
- Zero-Shot Dual Machine Translation
- Multi-Source Neural Machine Translation with Data Augmentation
- MMCR4NLP: Multilingual Multiway Corpora Repository for Natural Language Processing
- Improving a Multi-Source Neural Machine Translation Model with Corpus Extension for Low-Resource Languages
- Utilizing Lexical Similarity between Related, Low-resource Languages for Pivot-based SMT