110 citations · 236 across the 25 of their papers we have counts for
7 papers · 1 filter
Revisiting the Uniform Information Density Hypothesis
Clara Meister, Tiago Pimentel, Patrick Haller +3
The uniform information density (UID) hypothesis posits a preference among language users for utterances structured such that information is distributed uniformly across a signal.…
Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models
Yiwen Wang, Jennifer Hu, Roger Levy +1
Prior work has shown that structural supervision helps English language models learn generalizations about syntactic phenomena such as subject-verb agreement. However, it remains u…
Structural Guidance for Transformer Language Models
Peng Qian, Tahira Naseem, Roger Levy +1
Transformer-based language models pre-trained on large amounts of text data have proven remarkably successful in learning generic transferable linguistic representations. Here we s…
A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans
Ethan Gotlieb Wilcox, Pranali Vani, Roger P. Levy
We present a targeted, scaled-up comparison of incremental processing in humans and neural language models by collecting by-word reaction time data for sixteen different syntactic…
What if This Modified That? Syntactic Interventions via Counterfactual Embeddings
Mycal Tucker, Peng Qian, Roger Levy
Neural language models exhibit impressive performance on a variety of tasks, but their internal reasoning may be difficult to understand. Prior art aims to uncover meaningful prope…
Learning Evolved Combinatorial Symbols with a Neuro-symbolic Generative Model
Matthias Hofer, Tuan Anh Le, Roger Levy +1
Humans have the ability to rapidly understand rich combinatorial concepts from limited data. Here we investigate this ability in the context of auditory signals, which have been ev…
Child-directed Listening: How Caregiver Inference Enables Children's Early Verbal Communication
Stephan C. Meylan, Ruthe Foushee, Elika Bergelson +1
How do adults understand children's speech? Children's productions over the course of language development often bear little resemblance to typical adult pronunciations, yet caregi…