activity
20232026
most citedManipulate-Anything: Automating Real-World Robots using Vision-Language Models

5 citations · 14 across the 19 of their papers we have counts for

collaborators
Showing 2024Show all

6 papers · 1 filter

cs.RO2024

RoboMD: Uncovering Robot Vulnerabilities through Semantic Potential Fields

Som Sagar, Jiafei Duan, Sreevishakh Vasudevan +4

Robot manipulation policies, while central to the promise of physical AI, are highly vulnerable in the presence of external variations in the real world. Diagnosing these vulnerabi…

cs.RO2024★ 4 cited

AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation

Jiafei Duan, Wilbert Pumacay, Nishanth Kumar +7

Robotic manipulation in open-world settings requires not only task execution but also the ability to detect and learn from failures. While recent advances in vision-language models…

cs.RO2024★ 2 cited

RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics

Wentao Yuan, Jiafei Duan, Valts Blukis +5

From rearranging objects on a table to putting groceries into shelves, robots must plan precise action points to perform tasks accurately and reliably. In spite of the recent adopt…

cs.RO2024★ 5 cited

Manipulate-Anything: Automating Real-World Robots using Vision-Language Models

Jiafei Duan, Wentao Yuan, Wilbert Pumacay +4

Large-scale endeavors like and widespread community efforts such as Open-X-Embodiment have contributed to growing the scale of robot demonstration data. However, there is still an…

cs.HC2024

EVE: Enabling Anyone to Train Robots using Augmented Reality

Jun Wang, Chun-Cheng Chang, Jiafei Duan +2

The increasing affordability of robot hardware is accelerating the integration of robots into everyday activities. However, training a robot to automate a task requires expensive t…

cs.RO2024★ 1 cited

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation

Wilbert Pumacay, Ishika Singh, Jiafei Duan +3

To realize effective large-scale, real-world robotic applications, we must evaluate how well our robot policies adapt to changes in environmental conditions. Unfortunately, a major…