5 papers
Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
Pengfei Yi, Yingjie Ma, Wenjiang Xu +4
Balancing high-level semantic reasoning with low-level reactive control remains a core challenge in visual robotic manipulation. While Vision-Language Models (VLMs) excel at cognit…
Coordinated Humanoid Manipulation with Choice Policies
Haozhi Qi, Yen-Jen Wang, Toru Lin +4
Humanoid robots hold great promise for operating in human-centric environments, yet achieving robust whole-body coordination across the head, hands, and legs remains a major challe…
PyRoki: A Modular Toolkit for Robot Kinematic Optimization
Chung Min Kim, Brent Yi, Hongsuk Choi +3
Robot motion can have many goals. Depending on the task, we might optimize for pose error, speed, collision, or similarity to a human demonstration. Motivated by this, we present P…
From Simple to Complex Skills: The Case of In-Hand Object Reorientation
Haozhi Qi, Brent Yi, Mike Lambeta +3
Learning policies in simulation and transferring them to the real world has become a promising approach in dexterous manipulation. However, bridging the sim-to-real gap for each ne…
Estimating Body and Hand Motion in an Ego-sensed World
Brent Yi, Vickie Ye, Maya Zheng +6
We present EgoAllo, a system for human motion estimation from a head-mounted device. Using only egocentric SLAM poses and images, EgoAllo guides sampling from a conditional diffusi…