50 citations · 132 across the 14 of their papers we have counts for
4 papers · 1 filter
General Proximal Incremental Aggregated Gradient Algorithms: Better and Novel Results under General Scheme
Tao Sun, Yuejiao Sun, Dongsheng Li +1
The incremental aggregated gradient algorithm is popular in network optimization and machine learning research. However, the current convergence results require the objective funct…
Heavy-ball Algorithms Always Escape Saddle Points
Tao Sun, Dongsheng Li, Zhe Quan +3
Nonconvex optimization algorithms with random initialization have attracted increasing attention recently. It has been showed that many first-order methods always avoid saddle poin…
Iteratively reweighted penalty alternating minimization methods with continuation for image deblurring
Tao Sun, Dongsheng Li, Hao Jiang +1
In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method a…
Non-ergodic Convergence Analysis of Heavy-Ball Algorithms
Tao Sun, Penghang Yin, Dongsheng Li +3
In this paper, we revisit the convergence of the Heavy-ball method, and present improved convergence complexity results in the convex setting. We provide the first non-ergodic O(1/…