Scale and Selection: What Makes Automatic Harness Evolution Work for Visual-Interface Robot Agents

Zhijie Wei, Ferris Tan, Jinghui Wang +1

When an off-the-shelf coding agent is used directly as a robot policy, observing a browser-based 3D interface through screenshots and acting by posing a virtual target gripper thro…