It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them

Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem +1

Vision-language models (VLMs) are increasingly used in place of human annotators, making it important that substitutability tests reflect the model rather than incidental evaluatio…