4 papers · 1 filter
Learning Generalizable Hand-Object Tracking from Synthetic Demonstrations
Yinhuai Wang, Runyi Yu, Hok Wai Tsui +9
We present a system for learning generalizable hand-object tracking controllers purely from synthetic data, without requiring any human demonstrations. Our approach makes two key c…
PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System
Huayi Wang, Wentao Zhang, Runyi Yu +10
Deploying humanoid robots to interact with real-world environments--such as carrying objects or sitting on chairs--requires generalizable, lifelike motions and robust scene percept…
Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data
Ke Fan, Shunlin Lu, Minyue Dai +6
Generating diverse and natural human motion sequences based on textual descriptions constitutes a fundamental and challenging research area within the domains of computer vision, g…
SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations
Runyi Yu, Yinhuai Wang, Qihan Zhao +4
We address a fundamental challenge in Reinforcement Learning from Interaction Demonstration (RLID): demonstration noise and coverage limitations. While existing data collection app…