5 papers
STRIDE: Evaluating Spatiotemporal Reasoning in Driving Edge Cases
Lieqi Liu, Rui gao, Jia-Chen Gu +6
In autonomous driving, perceiving surrounding objects is not enough: failing to understand how they move and interact over time can lead to dangerous decisions. Evaluating vision-l…
Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation
Wei Wang, Wenqiao Zhang, Yutong Lin +2
World modeling under partial observation requires reasoning about the complete worlds that remain compatible with limited visual evidence. Occluded objects and unseen regions can l…
EmbodiedSkills: World Action Model-augmented Cascaded Skills for Vision-Language-Action Agent
Wei Wang, Wenqiao Zhang, Yutong Lin +14
Vision-language-action (VLA) policies generate executable robot actions, but plausible proposals can have different consequences for the task. We present EmbodiedSkills, a skill-ba…
CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
Wei Wang, Yuqian Yuan, Tianwei Lin +4
Spatial intelligence requires multimodal large language models (MLLMs) to move beyond single-view perception and reason consistently about objects, visibility, geometry, and intera…
Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning
Yilue Qian, Peiyu Yu, Ying Nian Wu +3
Visual planning simulates how humans make decisions to achieve desired goals in the form of searching for visual causal transitions between an initial visual state and a final visu…