5 citations · 13 across the 6 of their papers we have counts for
3 papers · 1 filter
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token
Baohao Liao, David Thulke, Sanjika Hewavitharana +2
The pre-training of masked language models (MLMs) consumes massive computation to achieve good results on downstream NLP tasks, resulting in a large carbon footprint. In the vanill…
Back-translation for Large-Scale Multilingual Machine Translation
Baohao Liao, Shahram Khadivi, Sanjika Hewavitharana
This paper illustrates our approach to the shared task on large-scale multilingual machine translation in the sixth conference on machine translation (WMT-21). This work aims to bu…
Word-based Domain Adaptation for Neural Machine Translation
Shen Yan, Leonard Dahlmann, Pavel Petrushkov +2
In this paper, we empirically investigate applying word-level weights to adapt neural machine translation to e-commerce domains, where small e-commerce datasets and large out-of-do…