Beyond the Rosetta Stone: Unification Forces in Generalization Dynamics

Carter Blum, Katja Filippova, Ann Yuan +8

Large language models (LLMs) struggle with cross-lingual knowledge transfer: they hallucinate when asked in one language about facts expressed in a different language during traini…