Showing 2026Show all
3 papers · 1 filter
cs.LG2026
Sharper Analysis of Single-Loop Methods for Bilevel Optimization
Yubo Zhou, Jun Shu, Luo Luo +4
Bilevel optimization underpins many machine learning applications, including hyperparameter optimization, meta-learning, neural architecture search, and reinforcement learning. Whi…
math.OC2026
Why Does Adaptive Zeroth-Order Optimization Work?
Haishan Ye, Luo Luo
Zeroth-order (ZO) optimization is popular in real-world applications that accessing the gradient information is expensive or unavailable. Recently, adaptive ZO methods that normali…
cs.LG2026
On the Convergence of Single-Loop Stochastic Bilevel Optimization with Approximate Implicit Differentiation
Yubo Zhou, Luo Luo, Guang Dai +1
Stochastic Bilevel Optimization has emerged as a fundamental framework for meta-learning and hyperparameter optimization. Despite the practical prevalence of single-loop algorithms…