Encoded but Unused: Bounding the Sources of VLM Errors

Anat Veikherman, Mor Ventura, Nitay Calderon +2

In this paper, we investigate why vision-language models (VLMs) produce errors by decomposing them into two sources: visual-representation failures, in which the visual evidence re…