Copy First, Translate Later: Interpreting Translation Dynamics in Multilingual Pretraining

Felicia Körner, Maria Matveev, Florian Eichin +3

Large language models exhibit impressive cross-lingual capabilities. However, prior work analyzes this phenomenon through isolated factors and at sparse points during training, lim…