Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics

Jiahua Wang, Leqi Zheng, Jialong Wu +2

World models simulate environmental dynamics to enable embodied agents to plan and reason about future states. While real-world perception is inherently multimodal, existing approa…