Chebyshev Inertial Iteration for Accelerating Fixed-Point Iterations
arXiv:2001.03280 · doi:10.1109/LSP.2021.3073620
Abstract
A novel method which is called the Chebyshev inertial iteration for accelerating the convergence speed of fixed-point iterations is presented. The Chebyshev inertial iteration can be regarded as a valiant of the successive over relaxation or Krasnosel'ski\vı-Mann iteration utilizing the inverse of roots of a Chebyshev polynomial as iteration dependent inertial factors. One of the most notable features of the proposed method is that it can be applied to nonlinear fixed-point iterations in addition to linear fixed-point iterations. Linearization around the fixed point is the key for the analysis on the local convergence rate of the proposed method. The proposed method appears effective in particular for accelerating the proximal gradient methods such as ISTA. It is also proved that the proposed method can successfully accelerate almost any fixed-point iterations if all the eigenvalues of the Jacobian at the fixed point are real.
arXiv comment9 pages
References in corpus (12)
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Trainable ISTA for Sparse Signal Recovery
- Convergence Acceleration via Chebyshev Step: Plausible Interpretation of Deep-Unfolded Gradient Descent
Cited by in corpus (5)
- Theoretical Interpretation of Learned Step Size in Deep-Unfolded Gradient Descent
- Hubbard-Stratonovich Detector for Simple Trainable MIMO Signal Detection
- Chebyshev Inertial Landweber Algorithm for Linear Inverse Problems
- Artificial Intelligence Driven Channel Coding and Resource Optimization for Wireless Networks: A Systematic Survey
- Deep Unfolded Multicast Beamforming