4 papers
Learning Language Specific Sub-network for Multilingual Machine Translation
Zehui Lin, Liwei Wu, Mingxuan Wang +1
Multilingual neural machine translation aims at learning a single translation model for multiple languages. These jointly trained models often suffer from performance degradation o…
The Volctrans Machine Translation System for WMT20
Liwei Wu, Xiao Pan, Zehui Lin +3
This paper describes our VolcTrans system on WMT20 shared news translation task. We participated in 8 translation directions. Our basic systems are based on Transformer, with sever…
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information
Zehui Lin, Xiao Pan, Mingxuan Wang +4
We investigate the following question for machine translation (MT): can we develop a single universal MT model to serve as the common seed and obtain derivative and improved models…
DropAttention: A Regularization Method for Fully-Connected Self-Attention Networks
Lin Zehui, Pengfei Liu, Luyao Huang +3
Variants dropout methods have been designed for the fully-connected layer, convolutional layer and recurrent layer in neural networks, and shown to be effective to avoid overfittin…