2 papers
cs.AI2026
Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation
Pengshuai Yang, Zijing Gao, Xue Yu +3
Evaluating language-guided mobile agents has recently shifted from rule-based to model-based approaches to achieve scalable and automated assessments. However, existing holistic ev…
cs.SE2025
SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models
Jingxuan Xu, Ken Deng, Weihao Li +36
Evaluating large language models (LLMs) for software engineering has been limited by narrow task coverage, language bias, and insufficient alignment with real-world developer workf…