5 papers · 1 filter
A Systematic Comparison of Multilingual Interpretability Methods Reveals Anisotropy-Driven Failures
Oskar Holmström, Marcel Bollmann, Marco Kuhlmann
Multilingual language models develop shared cross-lingual representations, and various interpretability methods claim to quantify this sharing. These methods have been developed la…
Probing Factual Knowledge Transfer with Training Data Interventions
Romina Oji, Marc Braun, Marcel Bollmann +2
Do multilingual language models transfer factual knowledge across languages during continued pretraining, or do they mostly recall facts learned directly from the target-language d…
A Dataset for Probing Translationese Preferences in English-to-Swedish Translation
Jenny Kunz, Anja Jarochenko, Marcel Bollmann
Translations often carry traces of the source language, a phenomenon known as translationese. We introduce the first freely available English-to-Swedish dataset contrasting transla…
Grow Up and Merge: Scaling Strategies for Efficient Language Adaptation
Kevin Glocker, Kätriin Kukk, Romina Oji +3
Achieving high-performing language models which include medium- and lower-resource languages remains a challenge. Massively multilingual models still underperform compared to langu…
How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP
Kushal Tatariya, Artur Kulmizev, Wessel Poelman +6
Wikipedia's perceived high quality and broad language coverage have established it as a fundamental resource in NLP. However, in recent years, such assumptions of high quality have…