3 papers
cs.CL2022
As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive Conditioning
Jannis Vamvas, Rico Sennrich
Omission and addition of content is a typical issue in neural machine translation. We propose a method for detecting such phenomena with off-the-shelf translation models. Using con…
cs.CL2021
On the Limits of Minimal Pairs in Contrastive Evaluation
Jannis Vamvas, Rico Sennrich
Minimal sentence pairs are frequently used to analyze the behavior of language models. It is often assumed that model behavior on contrastive pairs is predictive of model behavior…
cs.CL2020
X-Stance: A Multilingual Multi-Target Dataset for Stance Detection
Jannis Vamvas, Rico Sennrich
We extract a large-scale stance detection dataset from comments written by candidates of elections in Switzerland. The dataset consists of German, French and Italian text, allowing…