A Psycholinguistic Evaluation of Language Models' Sensitivity to Argument Roles

Eun-Kyoung Rosa Lee, Sathvik Nair, Naomi Feldman

We present a systematic evaluation of large language models' sensitivity to argument roles, i.e., who did what to whom, by replicating psycholinguistic studies on human argument ro…