Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs

Mikhail Sonkin, Tanja Baeumel, Daniil Gurgurov +2

Multilingual large language models (mLLMs) achieve strong performance in machine translation, yet our understanding of the mechanisms by which they transform representations from o…