Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation

Pengshuai Yang, Zijing Gao, Xue Yu +3

Evaluating language-guided mobile agents has recently shifted from rule-based to model-based approaches to achieve scalable and automated assessments. However, existing holistic ev…