26 citations · 44 across the 23 of their papers we have counts for
3 papers · 1 filter
Does CLIP Bind Concepts? Probing Compositionality in Large Image Models
Martha Lewis, Nihal V. Nayak, Peilin Yu +4
Large-scale neural network models combining text and images have made incredible progress in recent years. However, it remains an open question to what extent such models encode co…
Linearly Mapping from Image to Text Space
Jack Merullo, Louis Castricato, Carsten Eickhoff +1
The extent to which text-only language models (LMs) learn to represent features of the non-linguistic world is an open question. Prior work has shown that pretrained LMs can be tau…
Pretraining on Interactions for Learning Grounded Affordance Representations
Jack Merullo, Dylan Ebert, Carsten Eickhoff +1
Lexical semantics and cognitive science point to affordances (i.e. the actions that objects support) as critical for understanding and representing nouns and verbs. However, study…