1 citations · 2 across the 10 of their papers we have counts for
11 papers
T-Rex: Tactile-Reactive Dexterous Manipulation
Dantong Niu, Zhuoyang Liu, Zekai Wang +31
The ability to react dynamically to tactile signals has long been considered crucial to agile human-level dexterity. Yet contemporary learning-based Vision-Language-Action (VLA) mo…
Mana: Dexterous Manipulation of Articulated Tools
Zhao-Heng Yin, Guanya Shi, Pieter Abbeel +1
Articulated tool manipulation remains a major challenge in dexterous robotics due to the need to coordinate internal degrees of freedom and contact-rich interactions. While prior w…
How to Peel with a Knife: Aligning Fine-Grained Manipulation with Human Preference
Toru Lin, Shuying Deng, Zhao-Heng Yin +2
Many essential manipulation tasks - such as food preparation, surgery, and craftsmanship - remain difficult for autonomous robots. These tasks are characterized not only by contact…
Lightning Grasp: High Performance Procedural Grasp Synthesis with Contact Fields
Zhao-Heng Yin, Pieter Abbeel
Despite years of research, real-time diverse grasp synthesis for dexterous hands remains an unsolved core challenge in robotics and computer graphics. We present Lightning Grasp, a…
Object-centric 3D Motion Field for Robot Learning from Human Videos
Zhao-Heng Yin, Sherry Yang, Pieter Abbeel
Learning robot control policies from human videos is a promising direction for scaling up robot learning. However, how to extract action knowledge (or action representations) from…
FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control
Younggyo Seo, Carmelo Sferrazza, Haoran Geng +3
Reinforcement learning (RL) has driven significant progress in robotics, but its complexity and long training times remain major bottlenecks. In this report, we introduce FastTD3,…
Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithm
Zhao-Heng Yin, Changhao Wang, Luis Pineda +4
We introduce Geometric Retargeting (GeoRT), an ultrafast, and principled neural hand retargeting algorithm for teleoperation, developed as part of our recent Dexterity Gen (DexGen)…
DexterityGen: Foundation Controller for Unprecedented Dexterity
Zhao-Heng Yin, Changhao Wang, Luis Pineda +11
Teaching robots dexterous manipulation skills, such as tool use, presents a significant challenge. Current approaches can be broadly categorized into two strategies: human teleoper…
Offline Imitation Learning Through Graph Search and Retrieval
Zhao-Heng Yin, Pieter Abbeel
Imitation learning is a powerful machine learning algorithm for a robot to acquire manipulation skills. Nevertheless, many real-world manipulation tasks involve precise and dextero…
Twisting Lids Off with Two Hands
Toru Lin, Zhao-Heng Yin, Haozhi Qi +2
Manipulating objects with two multi-fingered hands has been a long-standing challenge in robotics, due to the contact-rich nature of many manipulation tasks and the complexity inhe…
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing
Ying Yuan, Haichuan Che, Yuzhe Qin +6
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual feedback. However, the distinct nature of these modalities poses significant challenges. In…