48 citations · 120 across the 10 of their papers we have counts for
11 papers
Small Batch Sizes Improve Training of Low-Resource Neural MT
Àlex R. Atrio, Andrei Popescu-Belis
We study the role of an essential hyper-parameter that governs the training of Transformers for neural machine translation in a low-resource setting: the batch size. Using theoreti…
Subword Mapping and Anchoring across Languages
Giorgos Vernikos, Andrei Popescu-Belis
State-of-the-art multilingual systems rely on shared vocabularies that sufficiently cover all considered languages. To this end, a simple and frequently used approach makes use of…
Context in Neural Machine Translation: A Review of Models and Evaluations
Andrei Popescu-Belis
This review paper discusses how context has been used in neural machine translation (NMT) in the past two years (2017-2018). Starting with a brief retrospect on the rapid evolution…
Integrating Weakly Supervised Word Sense Disambiguation into Neural Machine Translation
Xiao Pu, Nikolaos Pappas, James Henderson +1
This paper demonstrates that word sense disambiguation (WSD) can improve neural machine translation (NMT) by widening the source context considered when modeling the senses of pote…
Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German
Pierre-Edouard Honnet, Andrei Popescu-Belis, Claudiu Musat +1
The goal of this work is to design a machine translation (MT) system for a low-resource family of dialects, collectively known as Swiss German, which are widely spoken in Switzerla…
Self-Attentive Residual Decoder for Neural Machine Translation
Lesly Miculicich Werlen, Nikolaos Pappas, Dhananjay Ram +1
Neural sequence-to-sequence networks with attention have achieved remarkable performance for machine translation. One of the reasons for their effectiveness is their ability to cap…