What Process Evaluation of Coding Agents Actually Measures: Action, Task, and Step Are Three Different Levels

Jiawei He, Mengyu Shi, Jie jia +2

Coding agents are increasingly evaluated not only by whether they solve a task, but also by how they execute it. However, existing process-level evaluations often treat action pred…