5 papers
TactAlign: Human-to-Robot Policy Transfer via Tactile Alignment
Youngsun Wi, Jessica Yin, Elvis Xiang +5
Human demonstrations collected by wearable devices (e.g., tactile gloves) provide fast and dexterous supervision for policy learning, and are guided by rich, natural tactile feedba…
OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer
Jessica Yin, Haozhi Qi, Youngsun Wi +7
Human video demonstrations provide abundant training data for learning robot policies, but video alone cannot capture the rich contact signals critical for mastering manipulation.…
Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations
Irmak Guzey, Haozhi Qi, Julen Urain +10
Learning multi-fingered robot policies from humans performing daily tasks in natural environments has long been a grand goal in the robotics community. Achieving this would mark si…
Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing
Jessica Yin, Haozhi Qi, Jitendra Malik +3
Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signal…
Proximity and Visuotactile Point Cloud Fusion for Contact Patches in Extreme Deformation
Jessica Yin, Paarth Shah, Naveen Kuppuswamy +5
Visuotactile sensors are a popular tactile sensing strategy due to high-fidelity estimates of local object geometry. However, existing algorithms for processing raw sensor inputs t…