How Sensitive Are LLM Leaderboard Claims to Hidden Model Selection?

Chen Yang, Xianyang Zhang, Jun Chen

LLM leaderboard gains can reflect selection among privately evaluated model variants, yet neither the number of variants nor their dependence is public. We ask how many hidden vari…