5 papers · 1 filter
Accelerated Gradient Descent by Concatenation of Stepsize Schedules
Zehao Zhang, Rujun Jiang
This work considers stepsize schedules for gradient descent on smooth convex objectives. We extend the existing literature and propose a unified technique for constructing stepsize…
Adaptive Algorithms for Nonconvex Bilevel Optimization under PÅ Conditions
Xu Shi, Yinglin Du, Rufeng Xiao +1
Existing methods for nonconvex bilevel optimization (NBO) require prior knowledge of first- and second-order problem-specific parameters (e.g., Lipschitz constants and the Polyak-Å…
An Adaptive Algorithm for Bilevel Optimization on Riemannian Manifolds
Xu Shi, Rufeng Xiao, Rujun Jiang
Existing methods for solving Riemannian bilevel optimization (RBO) problems require prior knowledge of the problem's first- and second-order information and curvature parameter of…
Near-Optimal Algorithms for Convex Simple Bilevel Optimization under Weak Assumptions
Rujun Jiang, Xu Shi, Weizheng Song +1
This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimizati…
Penalty-based Methods for Simple Bilevel Optimization under Hölderian Error Bounds
Pengyu Chen, Xu Shi, Rujun Jiang +1
This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing me…