BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM

Zhewen Shen, Aditya Joshi, Ruey-Cheng Chen

Children from bilingual backgrounds benefit from interactions with parents and teachers to re-acquire their heritage language. In this paper, we investigate how this insight from b…