Asking What a Director Sees Can Change What Vision-Language Models Choose

Jiaxuan Guo, Xingyu Ren, Kejia Zhang +3

Vision-language models are now routinely tested on theory of mind: whether they can work out what another person sees, knows, and means. A common design asks the model to report th…