Beyond Isolated Tasks: A Framework for Evaluating Coding Agents on Sequential Software Evolution

KN Ajay Shastry, Ganesh Senrayan, Shrey Satapara +2

Existing datasets for coding agents evaluate performance on isolated, single pull request (PR) tasks in a stateless manner, failing to capture the reality of real-world software de…