When Vision-Language Models Judge Without Seeing: Exposing Informativeness Bias

Xiaohan Zou, Roshan Sridhar, Mohammadtaher Safarzadeh +1

The reliability of VLM-as-a-Judge is critical for the automatic evaluation of vision-language models (VLMs). Despite recent progress, our analysis reveals that VLM-as-a-Judge often…