Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergence

Dries Rooryck, Alex Cai, Yonatan Belinkov +2

Children in multilingual communities often code-switch, using multiple languages in a single utterance. Can we induce cross-lingual alignment in language models by training on code…