Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization

Sara Venturini, Marianna de Santis, Jordan Patracone +3

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameter…