Benchmarking the Benchmarks: A Validity Audit of Tool-Calling Evaluation

Vishvesh Bhat, Jay Vaghasiya, Muhammad Ahmed Mohsin +1

Tool-calling benchmarks are increasingly used to rank language-model agents, yet their scores are often treated as ground truth without validating the evaluators themselves. We pre…