2 papers
cs.AI2026
Evaluating Model Capabilities After Benchmark Saturation
Morio Hamada, Jehyeok Yeon, Matteo Migliarini +2
Rapid advances in AI capabilities are causing benchmarks to saturate. Once several models approach perfect scores, a benchmark loses its power to differentiate between them, and wi…
cs.AI2026
Automated Transcript Analysis for Detecting Flaws in Agentic Benchmarks
Jeff Mohl, Nelson Gardner-Challis, Magda Dubois +6
Capabilities of frontier models are often assessed using agentic benchmarks. To trust these results, benchmarks must accurately measure what they claim to and be free from invalida…