3 citations · 11 across the 16 of their papers we have counts for
5 papers · 1 filter
Faster Stochastic Algorithms for Minimax Optimization under Polyak--Łojasiewicz Conditions
Lesi Chen, Boyuan Yao, Luo Luo
This paper considers stochastic first-order algorithms for minimax optimization under Polyak--Łojasiewicz (PL) conditions. We propose SPIDER-GDA for solving the finite-sum problem…
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Lesi Chen, Yaohua Ma, Jingzhao Zhang
In this work, we consider bilevel optimization when the lower-level problem is strongly convex. Recent works show that with a Hessian-vector product (HVP) oracle, one can provably…
Communication Efficient Distributed Newton Method with Fast Convergence Rates
Chengchang Liu, Lesi Chen, Luo Luo +1
We propose a communication and computation efficient second-order method for distributed optimization. For each iteration, our method only requires communication c…
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
Lesi Chen, Jing Xu, Luo Luo
We consider the optimization problem of the form , where the component is -mean-squared Lipschitz but…
On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis
Lesi Chen, Jing Xu, Jingzhao Zhang
Bilevel optimization reveals the inner structure of otherwise oblique optimization problems, such as hyperparameter tuning, neural architecture search, and meta-learning. A common…