4 papers
Video2Layout: Recall and Reconstruct Metric-Grounded Cognitive Map for Spatial Reasoning
Yibin Huang, Wang Xu, Wanyue Zhang +6
Spatial intelligence is a critical frontier for Multimodal Large Language Models (MLLMs), empowering them to comprehend the physical world. Drawing inspiration from human perceptio…
Scaling Spatial Reasoning in MLLMs through Programmatic Data Synthesis
Zhi Helu, Huang Jingjing, Xu Wang +9
Embodied intelligence, a grand challenge in artificial intelligence, is fundamentally constrained by the limited spatial understanding and reasoning capabilities of current models.…
TacEleven: generative tactic discovery for football open play
Siyao Zhao, Hao Ma, Zhiqiang Pu +4
Creating offensive advantages during open play is fundamental to football success. However, due to the highly dynamic and long-sequence nature of open play, the potential tactic sp…
Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture
Wanyue Zhang, Yibin Huang, Yangbin Xu +5
Spatial understanding is essential for Multimodal Large Language Models (MLLMs) to support perception, reasoning, and planning in embodied environments. Despite recent progress, ex…