Optimizing generalization on the train set: a novel gradient-based framework to train parameters and hyperparameters simultaneously

Karim Lounici, Katia Meziani, Benjamin Riu

Generalization is a central problem in Machine Learning. Most prediction methods require careful calibration of hyperparameters carried out on a hold-out \textit{validation} datase…