Off-the-Shelf Language-Vision Encoders Predict Human Gaze Preferences in Visual World Experiments

Rahul Murali Shankar, Titus von der Malsburg, Sebastian Padó

A central question for computational psycholinguistics is to what extent neural language models can serve as cognitively adequate models of human language processing. However, work…