4 papers · 1 filter
Native Design Bias: Studying the Impact of English Nativeness on Language Model Performance
Manon Reusens, Philipp Borchert, Jochen De Weerdt +1
Large Language Models (LLMs) excel at providing information acquired during pretraining on large-scale corpora and following instructions through user prompts. This study investiga…
Bridging Language Gaps: Enhancing Few-Shot Language Adaptation
Philipp Borchert, Jochen De Weerdt, Marie-Francine Moens
The disparity in language resources poses a challenge in multilingual NLP, with high-resource languages benefiting from extensive data, while low-resource languages lack sufficient…
Language Fusion for Parameter-Efficient Cross-lingual Transfer
Philipp Borchert, Ivan VuliÄ, Marie-Francine Moens +1
Limited availability of multilingual text corpora for training language models often leads to poor performance on downstream tasks due to undertrained representation spaces for lan…
Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages
Fabian David Schmidt, Philipp Borchert, Ivan VuliÄ +1
LLMs have become a go-to solution not just for text generation, but also for natural language understanding (NLU) tasks. Acquiring extensive knowledge through language modeling on…