The Dual Mechanisms of Spatial Variable Binding in Vision-Language Models

Kelly Cui, Nikhil Prakash, Shoval Messica +4

Many multimodal tasks, such as image captioning and visual question answering, require vision-language models (VLMs) to bind objects with their properties and spatial relations. Ye…