5 papers
Shared Autonomy Assisted by Impedance-Driven Anisotropic Guidance Field
Sihan Chen, Hang Xu, Yupu Lu +4
Shared autonomy (SA) enables robots to infer human intent and assist in its achievement. While most research focuses on improving intent inference, it overlooks whether humans can…
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models
Chen Wang, Fei Xia, Wenhao Yu +6
Learning to perform manipulation tasks from human videos is a promising approach for teaching robots. However, many manipulation tasks require changing control parameters during ta…
ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
Wenlong Huang, Chen Wang, Yunzhu Li +2
Representing robotic manipulation tasks as constraints that associate the robot and the environment is a promising way to encode desired robot behaviors. However, it remains unclea…
Object-Centric Dexterous Manipulation from Human Motion Data
Yuanpei Chen, Chen Wang, Yaodong Yang +1
Manipulating objects to achieve desired goal states is a basic but important skill for dexterous manipulation. Human hand motions demonstrate proficient manipulation capability, pr…
ARCap: Collecting High-quality Human Demonstrations for Robot Learning with Augmented Reality Feedback
Sirui Chen, Chen Wang, Kaden Nguyen +2
Recent progress in imitation learning from human demonstrations has shown promising results in teaching robots manipulation skills. To further scale up training datasets, recent wo…