6 papers · 1 filter
Cross-Embodiment Transfer via Behavior-Aligned Representations
Ajay Sridhar, Jensen Gao, Jonathan Yang +3
Recent progress in large-scale imitation learning for robot manipulation has been driven by leveraging datasets across a wide range of robot embodiments. However, achieving signifi…
VIA: Visual Interface Agent for Robot Control
Hengyuan Hu, Priya Sundaresan, Jensen Gao +1
Robot manipulation is a complex task that requires visual understanding, physical reasoning, planning, and closed-loop control. General-purpose foundation models (FMs) have grown r…
A Taxonomy for Evaluating Generalist Robot Manipulation Policies
Jensen Gao, Suneel Belkhale, Sudeep Dasari +3
Machine learning for robot manipulation promises to unlock generalization to novel tasks and environments. But how should we measure the progress of these policies towards generali…
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
Alexander Khazatsky, Karl Pertsch, Suraj Nair +98
The creation of large, diverse, high-quality robot manipulation datasets is an important stepping stone on the path toward more capable and robust robotic manipulation policies. Ho…
Efficient Data Collection for Robotic Manipulation via Compositional Generalization
Jensen Gao, Annie Xie, Ted Xiao +2
Data collection has become an increasingly important problem in robotic manipulation, yet there still lacks much understanding of how to effectively collect data to facilitate broa…
Physically Grounded Vision-Language Models for Robotic Manipulation
Jensen Gao, Bidipta Sarkar, Fei Xia +5
Recent advances in vision-language models (VLMs) have led to improved performance on tasks such as visual question answering and image captioning. Consequently, these models are no…