Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agents

Yuanhao Li, Hongbo Wang, Xuhong Chen +2

Outcome-only reinforcement learning gives software engineering (SWE) agents a terminal success signal but little direct guidance about intermediate decisions. We introduce Counterf…