Measuring Cross-Task Behavioral Consistency in Language Model Agents

Amritesh Banerjee, Pranil Raichura

Agent evaluation relies almost entirely on outcome metrics such as success rate, which capture whether an agent succeeds but not how consistently it behaves. We argue that behavior…