33 citations · 60 across the 7 of their papers we have counts for
10 papers
On the Limits of Model Merging for Multilinguality in Pre-Training
Seth Aycock, Fedor Vitiugin, Aleksandr Umnov +2
Endowing models with consistent multilingual performance can be achieved by mixing pre-training data, or post-training approaches such as language-specific model merging. In this w…
Modeling Latent Sentence Structure in Neural Machine Translation
Jasmijn Bastings, Wilker Aziz, Ivan Titov +1
Recently it was shown that linguistic structure predicted by a supervised parser can be beneficial for neural machine translation (NMT). In this work we investigate a more challeng…
Deep Generative Model for Joint Alignment and Word Representation
Miguel Rios, Wilker Aziz, Khalil Sima'an
This work exploits translation data as a source of semantically relevant learning signal for models of word representation. In particular, we exploit equivalence through translatio…
Graph Convolutional Encoders for Syntax-aware Neural Machine Translation
Jasmijn Bastings, Ivan Titov, Wilker Aziz +2
We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolu…
Multi30K: Multilingual English-German Image Descriptions
Desmond Elliott, Stella Frank, Khalil Sima'an +1
We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English-language datasets almost exc…
Tree-gram Parsing: Lexical Dependencies and Structural Relations
Khalil Sima'an
This paper explores the kinds of probabilistic relations that are important in syntactic disambiguation. It proposes that two widely used kinds of relations, lexical dependencies a…