More than Marketing? On the Information Value of AI Benchmarks for Practitioners

Amelia Hardy, Anka Reuel, Kiana Jafari Meimandi +6

Public AI benchmark results are widely broadcast by model developers as indicators of model quality within a growing and competitive market. However, these advertised scores do not…