activity
20162026
most citedTraining Tips for the Transformer Model

279 citations · 685 across the 70 of their papers we have counts for

collaborators
Showing 2018Show all

6 papers · 1 filter

cs.CL2018★ 43 cited

Trivial Transfer Learning for Low-Resource Neural Machine Translation

Tom Kocmi, Ondřej Bojar

Transfer learning has been proven as an effective technique for neural machine translation under low-resource conditions. Existing methods require a common target language, languag…

cs.CL2018★ 5 cited

SubGram: Extending Skip-gram Word Representation with Substrings

Tom Kocmi, Ondřej Bojar

Skip-gram (word2vec) is a recent method for creating vector representations of words ("distributed word representations") using a neural network. The representation gained populari…

cs.CL2018

Morphological and Language-Agnostic Word Segmentation for NMT

Dominik Macháček, Jonáš Vidra, Ondřej Bojar

The state of the art of handling rich morphology in neural machine translation (NMT) is to break word forms into subword units, so that the overall vocabulary size of these units f…

cs.CL2018★ 7 cited

Are BLEU and Meaning Representation in Opposition?

Ondřej Cífka, Ondřej Bojar

One of possible ways of obtaining continuous-space sentence representations is by training neural machine translation (NMT) systems. The recent attention mechanism however removes…

cs.CL2018★ 279 cited

Training Tips for the Transformer Model

Martin Popel, Ondřej Bojar

This article describes our experiments in neural machine translation using the recent Tensor2Tensor framework and the Transformer sequence-to-sequence model (Vaswani et al., 2017).…

cs.CL2018★ 4 cited

Extracting Parallel Paragraphs from Common Crawl

Jakub Kúdela, Irena Holubová, Ondřej Bojar

Most of the current methods for mining parallel texts from the web assume that web pages of web sites share same structure across languages. We believe that there still exists a no…