Attention in Space: Functional Roles of VLM Heads for Spatial Reasoning

Xueqi Ma, Shuo Yang, Yanbei Jiang +6

Despite remarkable advances in large Vision-Language Models (VLMs), spatial reasoning remains a persistent challenge. In this work, we investigate how attention heads within VLMs c…