Showing 2026Show all
3 papers · 1 filter
math.OC2026
On Second-Order Methods for Bilevel Optimization
Jiawen Bi, Jiaxiang Li, Mingyi Hong +1
Bilevel optimization is an indispensable modeling tool for modern machine learning and engineering design. However, the theory and practice for finding second order stationary poin…
math.OC2026
On the Nature of Regularity Assumptions in Bilevel Optimization with Constrained Lower-level Problem
Xiaotian Jiang, Chang He, Mingyi Hong +1
In this paper, we study the regularity assumptions commonly adopted in bilevel optimization with constrained lower-level problems, including the linear independence constraint qual…
cs.LG2026
Natural Hypergradient Descent: Algorithm Design, Convergence Analysis, and Parallel Implementation
Deyi Kong, Zaiwei Chen, Shuzhong Zhang +1
In this work, we propose Natural Hypergradient Descent (NHGD), a new method for solving bilevel optimization problems. To address the computational bottleneck in hypergradient esti…