A Vision Check-up for Language Models

Pratyusha Sharma, Tamar Rott Shaham, Manel Baradad +5

What does learning to model relationships between strings teach large language models (LLMs) about the visual world? We systematically evaluate LLMs' abilities to generate and reco…