Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World

Kaixiang Yao, Xu Wang, Miao Pan +7

Spatial reasoning is essential for vision-language models (VLMs) to understand and act in the physical world. Reasoning in dynamic environments requires VLMs to perceive local stat…