Minimax Limits of k-Fold Cross-Validation via Majority

Ido Nachum, Rüdiger Urbanke, Thomas Weinberger

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the wides…