Benchmarking on Tasks That Matter: Dataset Selection for Preserving Model Rankings

Rostislav Gusev, Alexey Zaytsev

Benchmarks of machine learning models often include many datasets, making evaluation expensive. For efficiency, it is preferable to perform evaluations on small, representative dat…