192 citations · 585 across the 33 of their papers we have counts for
4 papers · 1 filter
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
Shuming Ma, Jian Yang, Haoyang Huang +10
Multilingual machine translation enables a single model to translate between different languages. Most existing multilingual machine translation systems adopt a randomly initialize…
Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions
Muhammad N. ElNokrashy, Amr Hendy, Mohamed Abdelghaffar +3
This paper describes our submission to the WMT20 sentence filtering task. We combine scores from (1) a custom LASER built for each source language, (2) a classifier built to distin…
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding
Young Jin Kim, Hany Hassan Awadalla
Transformer-based models are the state-of-the-art for Natural Language Understanding (NLU) applications. Models are getting bigger and better on various tasks. However, Transformer…
Multi-task Learning for Multilingual Neural Machine Translation
Yiren Wang, ChengXiang Zhai, Hany Hassan Awadalla
While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual…