Bridging the Gap Between Multimodal Foundation Models and World Models

Xuehai He

Humans understand the world through the integration of multiple sensory modalities, enabling them to perceive, reason about, and imagine dynamic physical processes. Inspired by thi…