6 papers
Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
Shukai Gong, Xuanran Zhai, Yintianrun Zhang +16
Long-horizon compositional manipulation has become increasingly important for real-world robot deployment, where a single task involves multiple coordinated subtasks. Existing worl…
HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining
Juncheng Ma, Jianxin Bi, Yufan Deng +19
Embodied foundation models are expected to benefit from data scaling like large language models, but face a much tighter data bottleneck. Teleoperated real-robot trajectories remai…
HumanNet: Scaling Human-centric Video Learning to One Million Hours
Yufan Deng, Daquan Zhou
Progress in embodied intelligence increasingly depends on scalable data infrastructure. While vision and language have scaled with internet corpora, learning physical interaction r…
Syn4D: A Multiview Synthetic 4D Dataset
Zeren Jiang, Yushi Lan, Yihang Luo +8
Dense 3D reconstruction and tracking of dynamic scenes from monocular video remains an important open challenge in computer vision. Progress in this area has been constrained by th…
Anymate: A Dataset and Baselines for Learning 3D Object Rigging
Yufan Deng, Yuhao Zhang, Chen Geng +2
Rigging and skinning are essential steps to create realistic 3D animations, often requiring significant expertise and manual effort. Traditional attempts at automating these proces…
DragVideo: Interactive Drag-style Video Editing
Yufan Deng, Ruida Wang, Yuhao Zhang +2
Video generation models have shown their superior ability to generate photo-realistic video. However, how to accurately control (or edit) the video remains a formidable challenge.…