Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments

Rohith Reddy Bellibatlu, Zichong Wang, Wenbin Zhang

Tool-using agents are entering settings where a wrong action carries real cost, and the benchmarks certifying them grade what each simulated tool call reports having done, assuming…