Why are language models less surprised than humans? Testing the Parse Multiplicity Mismatch Hypothesis

William Timkey, Brian Dillon, Tal Linzen

Surprisal theory posits that the processing difficulty of a word is determined by its predictability in context, offering a potential link between human sentence processing and nex…