Knowing Isn't Always Saying: When Do Spatial Encodings Reach Answers in Vision-Language Models?

Zeyu Wang, Xinming Xu

Vision-language models are known to encode spatial information in their hidden states, yet often fail to use it when answering. However, it remains unclear when and where this enco…