CLIMB: Curriculum Learning for Infant-inspired Model Building

Richard Diehl Martinez, Zebulon Goriely, Hope McGovern +4

We describe our team's contribution to the STRICT-SMALL track of the BabyLM Challenge. The challenge requires training a language model from scratch using only a relatively small t…