4 papers
FlowPilot: Real-Time World-Action Modeling for Agile UAV Navigation
Runqing Wang, Ding Yu, Pengyuan Min +6
We present FlowPilot, a compact world-action model for real-time onboard UAV navigation from depth. Unlike map-then-optimize pipelines that require local reconstruction or end-to-e…
Mixture-of-World Models: Scaling Multi-Task Reinforcement Learning with Modular Latent Dynamics
Boxuan Zhang, Weipu Zhang, Zhaohan Feng +4
A fundamental challenge in multi-task reinforcement learning (MTRL) is achieving sample efficiency in visual domains where tasks exhibit substantial heterogeneity in both observati…
DyMoDreamer: World Modeling with Dynamic Modulation
Boxuan Zhang, Runqing Wang, Wei Xiao +5
A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-bas…
SPGrasp: Spatiotemporal Prompt-driven Grasp Synthesis in Dynamic Scenes
Yunpeng Mei, Hongjie Cao, Yinqiu Xia +4
Real-time interactive grasp synthesis for dynamic objects remains challenging as existing methods fail to achieve low-latency inference while maintaining promptability. To bridge t…