Are Benchmarks Reliable? Toward Structural Diagnosis via Item-Level Capability Boundaries

Haiquan Hu, Yuzhu Liang, Weicheng Tang +4

Evaluating large language models (LLMs) relies heavily on benchmark scores, yet aggregate metrics can obscure whether individual items serve their intended measurement purpose. BSD…