Efficient Benchmarking Is Just Feature Selection and Multiple Regression

Sam Bowyer, Acyr Locatelli, Kris Cao

Efficient benchmarking techniques aim to lower the computational cost of evaluating LLMs by predicting full benchmark scores using only a subset of a benchmark's questions. By refr…