45 citations · 301 across the 53 of their papers we have counts for
14 papers · 1 filter
LightSeq2: Accelerated Training for Transformer-based Models on GPUs
Xiaohui Wang, Yang Wei, Ying Xiong +5
Transformer-based neural models are used in many AI applications. Training these models is expensive, as it takes huge GPU resources and long duration. It is challenging because ty…
The Volctrans GLAT System: Non-autoregressive Translation Meets WMT21
Lihua Qian, Yi Zhou, Zaixiang Zheng +7
This paper describes the Volctrans' submission to the WMT21 news translation shared task for German->English translation. We build a parallel (i.e., non-autoregressive) translation…
Multilingual Translation via Grafting Pre-trained Language Models
Zewei Sun, Mingxuan Wang, Lei Li
Can pre-trained BERT for one language and GPT for another be glued together to translate texts? Self-supervised training using only monolingual data has led to the success of pre-t…
Learning Kernel-Smoothed Machine Translation with Retrieved Examples
Qingnan Jiang, Mingxuan Wang, Jun Cao +3
How to effectively adapt neural machine translation (NMT) models according to emerging cases without retraining? Despite the great success of neural machine translation, updating t…
Learning When to Translate for Streaming Speech
Qianqian Dong, Yaoming Zhu, Mingxuan Wang +1
How to find proper moments to generate partial sentence translation given a streaming speech input? Existing approaches waiting-and-translating for a fixed duration often break the…
Secoco: Self-Correcting Encoding for Neural Machine Translation
Tao Wang, Chengqi Zhao, Mingxuan Wang +3
This paper presents Self-correcting Encoding (Secoco), a framework that effectively deals with input noise for robust neural machine translation by introducing self-correcting pred…
The Volctrans Neural Speech Translation System for IWSLT 2021
Chengqi Zhao, Zhicheng Liu, Jian Tong +6
This paper describes the systems submitted to IWSLT 2021 by the Volctrans team. We participate in the offline speech translation and text-to-text simultaneous translation tracks. F…
Language Tags Matter for Zero-Shot Neural Machine Translation
Liwei Wu, Shanbo Cheng, Mingxuan Wang +1
Multilingual Neural Machine Translation (MNMT) has aroused widespread interest due to its efficiency. An exciting advantage of MNMT models is that they could also translate between…
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation
Xiao Pan, Mingxuan Wang, Liwei Wu +1
Existing multilingual machine translation approaches mainly focus on English-centric directions, while the non-English directions still lag behind. In this work, we aim to build a…
Learning Language Specific Sub-network for Multilingual Machine Translation
Zehui Lin, Liwei Wu, Mingxuan Wang +1
Multilingual neural machine translation aims at learning a single translation model for multiple languages. These jointly trained models often suffer from performance degradation o…
Learning Shared Semantic Space for Speech-to-Text Translation
Chi Han, Mingxuan Wang, Heng Ji +1
Having numerous potential applications and great impact, end-to-end speech translation (ST) has long been treated as an independent task, failing to fully draw strength from the ra…
Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation
Tao Wang, Chengqi Zhao, Mingxuan Wang +2
Automatic translation of dialogue texts is a much needed demand in many real life scenarios. However, the currently existing neural machine translation delivers unsatisfying result…
End-to-end Speech Translation via Cross-modal Progressive Training
Rong Ye, Mingxuan Wang, Lei Li
End-to-end speech translation models have become a new trend in research due to their potential of reducing error propagation. However, these models still suffer from the challenge…
Counter-Interference Adapter for Multilingual Machine Translation
Yaoming Zhu, Jiangtao Feng, Chengqi Zhao +2
Developing a unified multilingual model has long been a pursuit for machine translation. However, existing approaches suffer from performance degradation -- a single multilingual m…