HSPR: Recovering Software-Agent Benchmark Scores via Hierarchical Posterior Inference

Wanyi Chen, Wanqin Shen, Yuanchen Shi +2

Evaluating software agents on a full benchmark is expensive. A small task subset can preserve agent rankings while yielding inaccurate scores. Historical responses provide useful s…