When to Call an Apple Red: Humans Follow Introspective Rules, VLMs Don't

Jonathan Nemitz, Carsten Eickhoff, Junyi Jessy Li +3

Understanding when Vision-Language Models (VLMs) will behave unexpectedly, whether models can reliably predict their own behavior, and if models adhere to their introspective reaso…