Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Linguistic Structure Induction from Language Models
Omar Momen
Linear sequences of words are implicitly represented in our brains by hierarchical structures that organize the composition of words in sentences. Linguists formalize different fra…
cs.CL2023
Increasing The Performance of Cognitively Inspired Data-Efficient Language Models via Implicit Structure Building
Omar Momen, David Arps, Laura Kallmeyer
In this paper, we describe our submission to the BabyLM Challenge 2023 shared task on data-efficient language model (LM) pretraining (Warstadt et al., 2023). We train transformer-b…