4 papers · 1 filter
Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction
Xinyi Li, Zaishuo Xia, Chenjie Hao +1
World models are expected to support imagination over extended temporal horizons, yet most are still trained through local few-step prediction objectives and deployed by recursivel…
Improving Weak World Models Behind Strong Agents in Atari Pong
Yukuan Lu, Zaishuo Xia, Weyl Lu +1
Strong world-model agents frequently contain weak world models. We study this agent-world-model gap by reproducing five visual world-model agents in Atari Pong: DreamerV3, DIAMOND,…
MotionPyramid: Hierarchical Motion Representation and Residual Interfaces
Gao Zhu, Zaishuo Xia, Yubei Chen
We ask whether the representational hierarchy seen in perception, from local primitives such as edges to higher level structures such as parts and objects, can be established for m…
How Do Large Language Models Learn Concepts During Continual Pre-Training?
Barry Menglong Yao, Sha Li, Yunzhi Yao +4
Human beings primarily understand the world through concepts (e.g., dog), abstract mental representations that structure perception, reasoning, and learning. However, how large lan…