Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
The AI Evaluation Ecosystem
Yash Dave, Sang T. Truong, Serena Wang +1
AI evaluation shapes the decisions of model providers, users, funders, and regulators. We argue that designing valid benchmarks requires contextualizing design choices in the dynam…
cs.AI2026
AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems
Michael Hardy, Anka Reuel, Lijin Zhang +6
While aggregate leaderboard scores drive AI development, they contain substantial measurement noise whose sources and magnitudes remain unquantified, making it unclear when ranking…