A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima

Daouda Sow, Kaiyi Ji, Ziwei Guan +1

Bilevel optimization has found extensive applications in modern machine learning problems such as hyperparameter optimization, neural architecture search, meta-learning, etc. While…