Translation Heads: Disentangling meaning from language in LLM-based machine translation

Théo Lasnier, Armel Zebaze, Djamé Seddah +2

Mechanistic Interpretability (MI) seeks to explain how neural networks implement their capabilities, but the scale of Large Language Models (LLMs) has limited prior MI work in Mach…