Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Do Syntax Heads Influence Model Behavior?
William Timkey, Tal Linzen
Transformer language models develop attention heads that specialize in syntactic relations, for example, attending from verbs to their subjects. Do these heads play a causal role i…
cs.CL2026
Why are language models less surprised than humans? Testing the Parse Multiplicity Mismatch Hypothesis
William Timkey, Brian Dillon, Tal Linzen
Surprisal theory posits that the processing difficulty of a word is determined by its predictability in context, offering a potential link between human sentence processing and nex…