33 citations · 53 across the 14 of their papers we have counts for
4 papers · 1 filter
NBCLT: Parameter-Agnostic Norm-Ball Clipped Local Training
Linxuan Pan, Shucheng Yang, Junchi Yang
Distributed learning with multiple local steps reduces communication but aggravates drift, and its practical performance often depends on carefully tuned hyperparameters under hete…
Optimal High-Order Methods for Solving Monotone Variational Inequalities
Xinliang Zhang, Lesi Chen, Linxuan Pan +3
We study second- and higher-order methods for solving smooth monotone variational inequalities (MVI). Monteiro and Svaiter (SIAM J. Optim., 2012) showed that a second-order method,…
An Lower Bound for Stochastic NC-SC Bilevel Optimization with First-order Oracles
Zhihao Gu, Qilong Wu, Junchi Yang
We study the oracle complexity of finding -stationary points of smooth bilevel optimization problems with a nonconvex upper-level objective and a strongly convex lower-level pro…
SGHA: A Single-Loop Fully First-Order Algorithm for Nonconvex-Strongly-Convex Bilevel Optimization
Zhihao Gu, Qilong Wu, Junchi Yang
In this work, we study the oracle complexity of finding an -stationary point for nonconvex-strongly-convex (NC-SC) bilevel optimization using only first-order oracles. Existing…