Evaluating Model Capabilities After Benchmark Saturation

Morio Hamada, Jehyeok Yeon, Matteo Migliarini +2

Rapid advances in AI capabilities are causing benchmarks to saturate. Once several models approach perfect scores, a benchmark loses its power to differentiate between them, and wi…