Neural Machine Translation: A Review of Methods, Resources, and Tools
arXiv:2012.15515
Abstract
Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machine translation (NMT) has achieved great success and has become the new mainstream method in practical MT systems. In this article, we first provide a broad review of the methods for NMT and focus on methods relating to architectures, decoding, and data augmentation. Then we summarize the resources and tools that are useful for researchers. Finally, we conclude with a discussion of possible future research directions.
arXiv commentAccepted by AI Open
References in corpus (34)
- Adam: A Method for Stochastic Optimization
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Sequence to Sequence Learning with Neural Networks
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Convolutional Sequence to Sequence Learning
- MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
- Cross-lingual Language Model Pretraining
- Dual Learning for Machine Translation
- Achieving Human Parity on Automatic Chinese to English News Translation
- Non-Autoregressive Neural Machine Translation
- Generating Natural Adversarial Examples
- Neural Machine Translation in Linear Time
- Word Translation Without Parallel Data
- Depthwise Separable Convolutions for Neural Machine Translation
- Phrase-Based & Neural Unsupervised Machine Translation
- Unsupervised Machine Translation Using Monolingual Corpora Only
- Sockeye: A Toolkit for Neural Machine Translation
- Insertion Transformer: Flexible Sequence Generation via Insertion Operations
- Is Neural Machine Translation Ready for Deployment? A Case Study on 30 Translation Directions
- An Effective Approach to Unsupervised Machine Translation
- Investigating Backtranslation in Neural Machine Translation
- Understanding Back-Translation at Scale
- Unsupervised Neural Machine Translation
- THUMT: An Open Source Toolkit for Neural Machine Translation
- Syntactically Supervised Transformers for Faster Neural Machine Translation
- Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputs
- Are Transformers universal approximators of sequence-to-sequence functions?
- Pre-trained Language Model Representations for Language Generation
- Improving Sequence-to-Sequence Learning via Optimal Transport
- Unsupervised Neural Machine Translation with Weight Sharing
- Neural Machine Translation: Challenges, Progress and Future
- Improving Back-Translation with Uncertainty-based Confidence Estimation
- Multi-Granularity Self-Attention for Neural Machine Translation
- Top-down Tree Structured Decoding with Syntactic Connections for Neural Machine Translation and Parsing