1 citations · 1 across the 3 of their papers we have counts for
4 papers · 1 filter
A Diagnostic Benchmark for Sweden-Related Factual Knowledge
Jenny Kunz
Many Swedish benchmarks are translations of US-centric benchmarks and are therefore not suitable for testing knowledge that is particularly relevant, or even specific, to Sweden. W…
How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters
Romina Oji, Jenny Kunz
This paper investigates the optimal use of the multilingual encoder model mDeBERTa for tasks in three Germanic languages -- German, Swedish, and Icelandic -- representing varying l…
Train More Parameters But Mind Their Placement: Insights into Language Adaptation with PEFT
Jenny Kunz
Smaller LLMs still face significant challenges even in medium-resourced languages, particularly when it comes to language-specific knowledge -- a problem not easily resolved with m…
The Impact of Language Adapters in Cross-Lingual Transfer for NLU
Jenny Kunz, Oskar Holmström
Modular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages. In particular, combining language adapters with task a…