4 papers
HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos
Yinhuai Wang, Qihan Zhao, Yuen Fui Lau +6
Enabling humanoid robots to perform agile and adaptive interactive tasks has long been a core challenge in robotics. Current approaches are bottlenecked by either the scarcity of r…
Learning Generalizable Hand-Object Tracking from Synthetic Demonstrations
Yinhuai Wang, Runyi Yu, Hok Wai Tsui +9
We present a system for learning generalizable hand-object tracking controllers purely from synthetic data, without requiring any human demonstrations. Our approach makes two key c…
PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System
Huayi Wang, Wentao Zhang, Runyi Yu +10
Deploying humanoid robots to interact with real-world environments--such as carrying objects or sitting on chairs--requires generalizable, lifelike motions and robust scene percept…
SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations
Runyi Yu, Yinhuai Wang, Qihan Zhao +4
We address a fundamental challenge in Reinforcement Learning from Interaction Demonstration (RLID): demonstration noise and coverage limitations. While existing data collection app…