Agents Are Systems, Not Models: Rethinking Agentic Evaluation

Luis Wiedmann, Leander Girrbach, Cordelia Schmid +1

Agent evaluations increasingly go beyond a single success rate, reporting metrics such as cost, consistency, and robustness. Yet they typically treat the agent itself as fixed. In…