91 citations · 165 across the 33 of their papers we have counts for
3 papers · 1 filter
Counterfactually Probing Language Identity in Multilingual Models
Anirudh Srinivasan, Venkata S Govindarajan, Kyle Mahowald
Techniques in causal analysis of language models illuminate how linguistic information is organized in LLMs. We use one such technique, AlterRep, a method of counterfactual probing…
Lil-Bevo: Explorations of Strategies for Training Language Models in More Humanlike Ways
Venkata S Govindarajan, Juan Diego Rodriguez, Kaj Bostrom +1
We present Lil-Bevo, our submission to the BabyLM Challenge. We pretrained our masked language models with three ingredients: an initial pretraining with music data, training on sh…
Dissociating language and thought in large language models
Kyle Mahowald, Anna A. Ivanova, Idan A. Blank +3
Large Language Models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. He…