Hyperparameter Tuning Through Pessimistic Bilevel Optimization

Meltem Apaydin Ustun, Liang Xu, Bo Zeng +1

Automated hyperparameter search in machine learning, especially for deep learning models, is typically formulated as a bilevel optimization problem, with hyperparameter values dete…