LinguaMap: Which Layers of LLMs Speak Your Language and How to Tune Them?

J. Ben Tamo, Daniel Carlander-Reuterfelt, Jonathan Rubin +3

Despite multilingual pretraining, large language models often struggle with non-English tasks, particularly in language control, the ability to respond in the intended language. We…