Toward Theoretical Guidance for Two Common Questions in Practical Cross-Validation based Hyperparameter Selection

Parikshit Ram, Alexander G. Gray, Horst C. Samulowitz +1

We show, to our knowledge, the first theoretical treatments of two common questions in cross-validation based hyperparameter selection: (1) After selecting the best hyperparameter…