8 citations · 14 across the 20 of their papers we have counts for
6 papers · 1 filter
Sparse Subnetwork Enhancement for Underrepresented Languages in Large Language Models
Daniil Gurgurov, Tanja Baeumel, Josef van Genabith +1
Large language models (LLMs) exhibit substantial performance disparities across languages, particularly between high- and low-resource settings. We propose a framework for improvin…
Modular Arithmetic: Language Models Solve Math Digit by Digit
Tanja Baeumel, Daniil Gurgurov, Yusser al Ghussin +2
While recent work has begun to uncover the internal strategies that Large Language Models (LLMs) employ for simple arithmetic tasks, a unified understanding of their underlying mec…
Multilingual Political Views of Large Language Models: Identification and Steering
Daniil Gurgurov, Katharina Trinley, Ivan Vykopal +3
Large language models (LLMs) are increasingly used in everyday tools and applications, raising concerns about their potential influence on political views. While prior research has…
Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
Daniil Gurgurov, Katharina Trinley, Yusser Al Ghussin +3
Large language models (LLMs) exhibit strong multilingual abilities, yet the neural mechanisms behind language-specific processing remain unclear. We analyze language-specific neuro…
On Multilingual Encoder Language Model Compression for Low-Resource Languages
Daniil Gurgurov, Michal Gregor, Josef van Genabith +1
In this paper, we combine two-step knowledge distillation, structured pruning, truncation, and vocabulary trimming for extremely compressing multilingual encoder-only language mode…
Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
Daniil Gurgurov, Ivan Vykopal, Josef van Genabith +1
Low-resource languages (LRLs) face significant challenges in natural language processing (NLP) due to limited data. While current state-of-the-art large language models (LLMs) stil…