Crossing the Validation Crisis: Cross-Validation Reduces Benchmarking Variance Surprisingly Well

Célestin Eve, Gaël Varoquaux, Thomas Moreau

Modern machine learning progresses through empirical work, benchmarking new methods to evaluate relative performance. However, the statistical variability inherent to evaluation -…