Understanding the Fine-Grained Knowledge Capabilities of Vision-Language Models

Dhruba Ghosh, Yuhui Zhang, Ludwig Schmidt

Vision-language models (VLMs) have made substantial progress across a wide range of visual question answering benchmarks, spanning visual reasoning, document understanding, and mul…