8 papers
Population-Scalable Multi-Agent World Modeling
Renjie Zhao, Yuxiang Wu, Mingyu Zhang +7
World models have recently achieved impressive progress in visual prediction and interactive generation, but extending them to multi-agent environments introduces a fundamental sca…
Engine-Native Editable 3D World Reconstruction with Objects and Lighting
Junhao Chen, Xinghao Chen, Henghaofan Zhang +8
Editable 3D scene creation requires object instances and lights that can be inspected, moved, and imported into standard engines, yet existing single-image methods largely stop at…
Learning 4D Geometric Priors for Inference-Efficient World Action Models
Jianjun Zhang, Jian Zhu, Taiyi Su +4
World Action Models (WAMs) have shown strong potential for robotic manipulation by jointly modeling visual future dynamics and executable action sequences. However, existing video-…
PiL-World: A Chunk-Wise World Model for VLA Policy-in-the-Loop Evaluation
Chong Ma, Taiyi Su, Jian Zhu +4
Vision-language-action (VLA) policies operate in a closed loop in real-world robot tasks: a robot observes the scene, executes an action chunk, and conditions its next decision on…
Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos
Taiyi Su, Jian Zhu, Yaxuan Li +5
Embodied world models aim to predict and interact with the physical world through visual observations and actions. However, existing models struggle to accurately translate low-lev…
Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent Space
Jian Zhu, Zhengyu Jia, Tian Gao +6
Advanced end-to-end autonomous driving systems predict other vehicles' motions and plan ego vehicle's trajectory. The world model that can foresee the outcome of the trajectory has…