4 papers
Restarted Reflected Halpern Acceleration for Augmented Primal-Dual Methods
Benqi Liu, Ju Cao, Wotao Yin +1
We study linearly constrained composite convex optimization with a smooth term and a proximable nonsmooth term. We develop a unified augmented primal-dual framework with primal-dua…
Unified Convergence Analysis for Adaptive Optimization with Moving Average Estimator
Zhishuai Guo, Yi Xu, Wotao Yin +2
Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. T…
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
Yutong He, Xinmeng Huang, Yiming Chen +2
Communication compression is an essential strategy for alleviating communication overhead by reducing the volume of information exchanged between computing nodes in large-scale dis…
Scaled Relative Graph of Normal Matrices
Xinmeng Huang, Ernest K. Ryu, Wotao Yin
The Scaled Relative Graph (SRG) is a geometric tool that maps the action of a multi-valued nonlinear operator onto the 2D plane, used to analyze the convergence of a wide range of…