activity
20152024
most citedRoot Mean Square Layer Normalization

106 citations · 785 across the 59 of their papers we have counts for

collaborators
Showing 2023Show all

9 papers · 1 filter

cs.CL2023

A Benchmark for Evaluating Machine Translation Metrics on Dialects Without Standard Orthography

Noëmi Aepli, Chantal Amrhein, Florian Schottmann +1

For sensible progress in natural language processing, it is important that we are aware of the limitations of the evaluation metrics we use. In this work, we evaluate how robust me…

cs.CL2023★ 2 cited

Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding

Rico Sennrich, Jannis Vamvas, Alireza Mohammadshahi

Hallucinations and off-target translation remain unsolved problems in MT, especially for low-resource languages and massively multilingual models. In this paper, we introduce two r…

cs.CL2023★ 7 cited

Uncertainty in Natural Language Generation: From Theory to Applications

Joris Baan, Nico Daheim, Evgenia Ilia +7

Recent advances of powerful Language Models have allowed Natural Language Generation (NLG) to emerge as an important technology that can not only perform traditional tasks like sum…

cs.CL2023★ 2 cited

Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model

Chantal Amrhein, Florian Schottmann, Rico Sennrich +1

Natural language generation models reproduce and often amplify the biases present in their training data. Previous research explored using sequence-to-sequence rewriting models to…

cs.CL2023

What's the Meaning of Superhuman Performance in Today's NLU?

Simone Tedeschi, Johan Bos, Thierry Declerck +9

In the last five years, there has been a significant focus in Natural Language Processing (NLP) on developing larger Pretrained Language Models (PLMs) and introducing benchmarks su…

cs.CL2023★ 14 cited

SLTUNET: A Simple Unified Model for Sign Language Translation

Biao Zhang, Mathias Müller, Rico Sennrich

Despite recent successes with neural models for sign language translation (SLT), translation quality still lags behind spoken languages because of the data scarcity and modality ga…

cs.CL2023

Towards Unsupervised Recognition of Token-level Semantic Differences in Related Documents

Jannis Vamvas, Rico Sennrich

Automatically highlighting words that cause semantic differences between two documents could be useful for a wide range of applications. We formulate recognizing semantic differenc…

cs.CL2023★ 1 cited

SwissBERT: The Multilingual Language Model for Switzerland

Jannis Vamvas, Johannes Graën, Rico Sennrich

We present SwissBERT, a masked language model created specifically for processing Switzerland-related text. SwissBERT is a pre-trained model that we adapted to news articles writte…

cs.CL2023

Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation

Biao Zhang, Barry Haddow, Rico Sennrich

For end-to-end speech translation, regularizing the encoder with the Connectionist Temporal Classification (CTC) objective using the source transcript or target translation as labe…