4 papers · 1 filter
Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Sets
Saeed Masiha, Zebang Shen, Negar Kiyavash +1
We study optimistic bilevel optimization when the lower-level problem has a non-isolated manifold of minimizers. In this setting, the hyper-objective may be non-differentiable beca…
On the Connectedness of Sublevel Sets in Invex Optimization
Vinzenz Thoma, Zebang Shen, Niao He
Understanding the topology of sublevel sets yields crucial insights into the optimization landscape of non-convex functions. If sublevel sets are connected, local search algorithms…
Superquantile-Gibbs Relaxation for Minima-selection in Bilevel Optimization
Saeed Masiha, Zebang Shen, Negar Kiyavash +1
Bilevel optimization (BLO) becomes more challenging when the lower-level objective admits multiple minimizers. Compared with the commonly studied unique-minimizer setting, this int…
Optimal Local Convergence Rates of Stochastic First-Order Methods under Local -PL
Saeed Masiha, Saber Salehkaleybar, Niao He +2
We study the local convergence rate of stochastic first-order methods under a local -Polyak-Lojasiewicz (-PL) condition in a neighborhood of a target connected component $\…