9 papers
V-VLAPS: Value-Guided Planning for Vision-Language-Action Models
Ke Ren, Ali Salamatian, Kieran Pattison +1
Vision-language-action (VLA) models provide strong action priors for robotic manipulation, but their reactive behavior can fail under distribution shift and long-horizon task struc…
EgoInfinity: A Web-Scale 4D Hand-Object Interaction Data Engine for Any-View Robot Retargeting and Video-to-Action Robot Learning
Gaotian Wang, Kejia Ren, Andrew Morgan +4
Internet videos constitute the largest reservoir of embodied human manipulation knowledge, yet converting arbitrary RGB footage into actionable robot training data remains a major…
Zero-Shot Sim-to-Real Robot Learning: A Dexterous Manipulation Study on Reactive Catching
Kejia Ren, Gaotian Wang, Andrew S. Morgan +1
Dexterous manipulation is physics-intensive and highly sensitive to modeling errors and perception noise, making sim-to-real transfer prohibitively challenging. Domain randomizatio…
ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
Gaotian Wang, Kejia Ren, Andrew S. Morgan +1
Dynamics models, whether simulators or learned world models, have long been central to robotic manipulation, but most focus on minimizing prediction error rather than confronting a…
MotionBits: Video Segmentation through Motion-Level Analysis of Rigid Bodies
Howard H. Qian, Kejia Ren, Yu Xiang +2
Rigid bodies constitute the smallest manipulable elements in the real world, and understanding how they physically interact is fundamental to embodied reasoning and robotic manipul…
Object-Centric Kinodynamic Planning for Nonprehensile Robot Rearrangement Manipulation
Kejia Ren, Gaotian Wang, Andrew S. Morgan +2
Nonprehensile actions such as pushing are crucial for addressing multi-object rearrangement problems. Many traditional methods generate robot-centric actions, which differ from int…