4 papers · 1 filter
Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation
Alessandro Raganato, Yves Scherrer, Jörg Tiedemann
Transformer-based models have brought a radical change to neural machine translation. A key feature of the Transformer architecture is the so-called multi-head attention mechanism,…
The University of Helsinki submissions to the WMT19 news translation task
Aarne Talman, Umut Sulubacak, Raúl Vázquez +5
In this paper, we present the University of Helsinki submissions to the WMT 2019 shared task on news translation in three language pairs: English-German, English-Finnish and Finnis…
Neural Machine Translation with Extended Context
Jörg Tiedemann, Yves Scherrer
We investigate the use of extended context in attention-based neural machine translation. We base our experiments on translated movie subtitles and discuss the effect of increasing…
The Helsinki Neural Machine Translation System
Robert Östling, Yves Scherrer, Jörg Tiedemann +2
We introduce the Helsinki Neural Machine Translation system (HNMT) and how it is applied in the news translation task at WMT 2017, where it ranked first in both the human and autom…