8 papers
Robots as Tokens: Unified Diffusion Transformer for Coordinated Multi-Robot Trajectory Generation
Ruofei Bai, Jie Chen, Yuxin Cai +3
The success of generative models in language and visual generation has inspired extensive applications to generative robot planning. However, most existing works either focus on si…
ImagiNav: Scalable Embodied Navigation via Generative Visual Prediction and Inverse Dynamics
Jie Chen, Yuxin Cai, Yizhuo Wang +6
Enabling robots to navigate open-world environments via natural language is critical for general-purpose autonomy. Yet, Vision-Language Navigation has relied on end-to-end policies…
TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Control
Yuteng Sun, Haoran Wang, Ruofei Bai +4
Large-scale Vision-Language-Action (VLA) models offer semantic generalization but suffer from high inference latency because they adopt a low-frequency batch-and-execute paradigm.…
SHARE: Sharing Human Actions across Robot Embodiments through Unified Retargeting and Tracking
Haoyu Zhang, Junzhe Xu, Shibo Jin +8
The central challenge in reusing human actions across robots is the need to realize shared intent through incompatible kinematics, dynamics, and control interfaces. We present SHAR…
FlashRecovery: Fast and Low-Cost Recovery from Failures for Large-Scale Training of LLMs
Haijun Zhang, Jinxiang Wang, Zhenhua Yu +20
Large language models (LLMs) have made a profound impact across various fields due to their advanced capabilities. However, training these models at unprecedented scales requires e…
Self-supervised Pretraining for Integrated Prediction and Planning of Automated Vehicles
Yangang Ren, Guojian Zhan, Chen Lv +3
Predicting the future of surrounding agents and accordingly planning a safe, goal-directed trajectory are crucial for automated vehicles. Current methods typically rely on imitatio…
Astra: Toward General-Purpose Mobile Robots via Hierarchical Multimodal Learning
Sheng Chen, Peiyu He, Jiaxin Hu +67
Modern robot navigation systems encounter difficulties in diverse and complex indoor environments. Traditional approaches rely on multiple modules with small models or rule-based s…
Utilizing Navigation Paths to Generate Target Points for Enhanced End-to-End Autonomous Driving Planning
Yuanhua Shen, Jun Li
In recent years, end-to-end autonomous driving frameworks have been shown to not only enhance perception performance but also improve planning capabilities. However, most previous…