8 papers
EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video
Hyunjin Kim, Ri-Zhao Qiu, Guangqi Jiang +1
Humans naturally understand object physics through everyday interactions, but faithfully predicting complex deformable dynamics, such as elastic materials and fabrics, remains a ma…
Cross-Hand Latent Representation for Vision-Language-Action Models
Guangqi Jiang, Yutong Liang, Jianglong Ye +6
Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perceptio…
From Power to Precision: Learning Fine-grained Dexterity for Multi-fingered Robotic Hands
Jianglong Ye, Lai Wei, Guangqi Jiang +3
Human grasps can be roughly categorized into two types: power grasps and precision grasps. Precision grasping enables tool use and is believed to have influenced human evolution. T…
GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulation
Guangqi Jiang, Haoran Chang, Ri-Zhao Qiu +6
This paper presents GSWorld, a robust, photo-realistic simulator for robotics manipulation that combines 3D Gaussian Splatting with physics engines. Our framework advocates "closin…
Make-An-Agent: A Generalizable Policy Network Generator with Behavior-Prompted Diffusion
Yongyuan Liang, Tingqiang Xu, Kaizhe Hu +3
Can we generate a control policy for an agent using just one demonstration of desired behaviors as a prompt, as effortlessly as creating an image from a textual description? In thi…
RoboDuet: Learning a Cooperative Policy for Whole-body Legged Loco-Manipulation
Guoping Pan, Qingwei Ben, Zhecheng Yuan +6
Fully leveraging the loco-manipulation capabilities of a quadruped robot equipped with a robotic arm is non-trivial, as it requires controlling all degrees of freedom (DoFs) of the…