7 papers
Touch2Robot: Robot Touch in the Human Demonstration Loop
Shengcheng Luo, Xiaoyang Cheng, Hong Ying +6
Human demonstrations offer a scalable way to collect manipulation data, but their contacts may be unstable or infeasible when transferred to a robot hand. Collecting demonstrations…
CAAT: Contact-Aware Attention Scaling and Tactile Masking for Data-Efficient Contact-Rich Manipulation
Jiaming Jiang, Yuzhe Huang, Hao Liang +7
In contact-rich manipulation, visual observations primarily guide motion in free space, whereas tactile observations become particularly informative during contact. However, standa…
DexMani: Human-Derived Manipulability Guidance for Dexterous Rotation
Xiaoyang Chen, Shengcheng Luo, Haoran Guo +4
Dexterous object rotation is a sequential contact problem: each support, release, and re-contact decision must both produce the desired object motion, and prepare the hand configur…
Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learning
Shengcheng Luo, Xiyan Huang, Zhe Xu +3
Blind grasping with a dexterous hand is a crucial manipulation capability. Nevertheless, learning such tactile-only policies for real robots remains challenging due to the tactile…
Tac2Pix: Image-Space Visuo-Tactile Fusion for Dexterous Manipulation
Shengcheng Luo, Kefei Wu, Xiaoying Zhou +3
Vision and touch are naturally complementary for dexterous manipulation. Yet they are represented in fundamentally different forms: visual observations are dense and spatially stru…
DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level Control
Xinyu Xu, Shengcheng Luo, Yanchao Yang +2
Building a general-purpose intelligent home-assistant agent skilled in diverse tasks by human commands is a long-term blueprint of embodied AI research, which poses requirements on…
Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition
Shengcheng Luo, Quanquan Peng, Jun Lv +4
Employing a teleoperation system for gathering demonstrations offers the potential for more efficient learning of robot manipulation. However, teleoperating a robot arm equipped wi…