Seeing and Solving Are Not Enough for Vision-Language Models

Ziheng Wang, Mingxuan Xie, Yilin Liu +3

Vision-language models (VLMs) answer visual questions by combining visual information extraction with downstream problem solving. We investigate a fundamental question: Does an inc…