Anticipatory Evaluation of Language Models: Predicting LLM Benchmark Scores from Descriptions

Jungsoo Park, Ethan Mendes, Gabriel Stanovsky +1

Modern ML research increasingly faces an evaluation bottleneck: building benchmarks and running experiments is costly, slowing iteration. We ask how much can be inferred about eval…