29 citations · 53 across the 18 of their papers we have counts for
4 papers · 1 filter
Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks
Rochelle Choenni, Ekaterina Shutova, Dan Garrette
Recent work has proposed explicitly inducing language-wise modularity in multilingual LMs via sparse fine-tuning (SFT) on per-language subnetworks as a means of better guiding cros…
Do large language models solve verbal analogies like children do?
Claire E. Stevenson, Mathilde ter Veen, Rochelle Choenni +2
Analogy-making lies at the heart of human cognition. Adults solve analogies such as \textit{Horse belongs to stable like chicken belongs to ...?} by mapping relations (\textit{kept…
Probing LLMs for Joint Encoding of Linguistic Categories
Giulio Starace, Konstantinos Papakostas, Rochelle Choenni +4
Large Language Models (LLMs) exhibit impressive performance on a range of NLP tasks, due to the general-purpose linguistic knowledge acquired during pretraining. Existing model int…
How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning
Rochelle Choenni, Dan Garrette, Ekaterina Shutova
Multilingual large language models (MLLMs) are jointly trained on data from many different languages such that representation of individual languages can benefit from other languag…