13 papers
Dual Exam: Controlled Evaluation of Multimodal Agents and World Models
Zhefan Rao, Meng Chu, Xuan Zhang +80
World Models (WMs) can support Multimodal Agents (MAs) through simulated experience, while Agent trajectories can inform World Model refinement. Evaluating this interaction require…
Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
Jinzhou Tang, Zijun Zhang, Jing Yang +10
Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on manual environment construction…
RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement
Wenyi Wu, Minghao Fu, Jieyu You +10
Recent advances in large language models have made automatic game generation increasingly feasible, yet reliably improving generated games beyond a playable version remains challen…
Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling
Fan Feng, Yujia Zheng, Minghao Fu +5
Learning and planning in imagination using world models provides an effective paradigm for training agents for decision-making. However, existing approaches often rely on high-dime…
RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation
Pengzhi Yang, Xinyu Wang, Pengyu Jing +7
Reinforcement learning for robot manipulation is often bottlenecked by reward design, especially in long-horizon tasks: sparse success rewards provide weak supervision, while hand-…
Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations
Minghao Fu, Fan Feng, Nicklas Hansen +1
World models enable agents to predict future dynamics conditioned on actions, making the choice of latent representation central to planning and control. Such representations are o…
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
Fan Feng, Selena Ge, Minghao Fu +6
Recent work has framed decision-making as a sequence modeling problem using generative models such as diffusion models. Although promising, these approaches often overlook latent f…
SCAR: Self-Supervised Continuous Action Representation Learning
Hongjia Liu, Fan Feng, Minghao Fu +3
Despite the central role of action in embodied intelligence, learning transferable action representations from visual transitions remains a fundamental challenge, particularly when…
Towards Identifiability of Hierarchical Temporal Causal Representation Learning
Zijian Li, Minghao Fu, Junxian Huang +5
Modeling hierarchical latent dynamics behind time series data is critical for capturing temporal dependencies across multiple levels of abstraction in real-world tasks. However, ex…
Online Time Series Forecasting with Theoretical Guarantees
Zijian Li, Changze Zhou, Minghao Fu +6
This paper is concerned with online time series forecasting, where unknown distribution shifts occur over time, i.e., latent variables influence the mapping from historical to futu…
PersonaX: Multimodal Datasets with LLM-Inferred Behavior Traits
Loka Li, Wong Yu Kang, Minghao Fu +7
Understanding human behavior traits is central to applications in human-computer interaction, computational social science, and personalized AI systems. Such understanding often re…
Infant Cry Detection Using Causal Temporal Representation
Minghao Fu, Danning Li, Aryan Gadhiya +8
This paper addresses a major challenge in acoustic event detection, in particular infant cry detection in the presence of other sounds and background noises: the lack of precise an…
Learning General Causal Structures with Hidden Dynamic Process for Climate Analysis
Minghao Fu, Biwei Huang, Zijian Li +5
Understanding climate dynamics requires going beyond correlations in observational data to uncover the underlying causal process. Latent drivers such as atmospheric processes play…