OSWorld-Pro: Process-based Evaluation for Computer Use Agents

Zhilin Wang, Shaokun Zhang, Yifan Zhang +9

Evaluation of Computer-Use Agents (CUAs) is often limited to the final deliverables they create (at the end of hundreds of steps) and assessed with functional verifiers, as seen in…