Too Much Information: Keeping Training Simple for BabyLMs

Lukas Edman, Lisa Bylinina

This paper details the work of the University of Groningen for the BabyLM Challenge. We follow the idea that, like babies, language models should be introduced to simpler concepts…