Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act

Yuyang Dai, Bofei Huang, Hongbo Zhang +1

Vision-language models (VLMs) perform strongly on visual question answering benchmarks, yet often make decisions that contradict visual evidence they have already identified correc…