4 papers
Energy-Based Transformers as Predictors of Reading Difficulty
Jakub Dotlacil, Ece Takmaz
Transformer language models have become established tools for modeling human sentence processing, with measures such as surprisal and attention entropy serving as effective predict…
When Context Misleads: Surprisal, Energy and Attention Entropy as Metrics of Coherence Illusions in LLMs
Ece Takmaz, Nitin Kumar, Li Kloostra +1
Psycholinguistics studies show that human readers fall for coherence illusions: an incoherent discourse can seem coherent simply because a distractor matches what comes next. We in…
Correlates of Image Memorability in Vision Encoders: Activations, Attention Entropy, Patch Uniformity and Autoencoder Losses
Ece Takmaz, Albert Gatt, Jakub Dotlacil
Images vary in how memorable they are to humans. Inspired by findings from cognitive science and computer vision, we explore correlates of image memorability in pretrained transfor…
Model Merging to Maintain Language-Only Performance in Developmentally Plausible Multimodal Models
Ece Takmaz, Lisa Bylinina, Jakub Dotlacil
State-of-the-art vision-and-language models consist of many parameters and learn from enormous datasets, surpassing the amounts of linguistic data that children are exposed to as t…