Convergence theory for preconditioned eigenvalue solvers in a nutshell
arXiv:1412.5005 · doi:10.1007/s10208-015-9297-1
Abstract
Preconditioned iterative methods for numerical solution of large matrix eigenvalue problems are increasingly gaining importance in various application areas, ranging from material sciences to data mining. Some of them, e.g., those using multilevel preconditioning for elliptic differential operators or graph Laplacian eigenvalue problems, exhibit almost optimal complexity in practice, i.e., their computational costs to calculate a fixed number of eigenvalues and eigenvectors grow linearly with the matrix problem size. Theoretical justification of their optimality requires convergence rate bounds that do not deteriorate with the increase of the problem size. Such bounds were pioneered by E. D'yakonov over three decades ago, but to date only a handful have been derived, mostly for symmetric eigenvalue problems. Just a few of known bounds are sharp. One of them is proved in [doi:10.1016/S0024-3795(01)00461-X] for the simplest preconditioned eigensolver with a fixed step size. The original proof has been greatly simplified and shortened in [doi:10.1137/080727567] by using a gradient flow integration approach. In the present work, we give an even more succinct proof, using novel ideas based on Karush-Kuhn-Tucker theory and nonlinear programming.
12 pages, accepted for Foundations of Computational Mathematics 2015
References in corpus (1)
Cited by in corpus (5)
- Accelerating Nuclear Configuration Interaction Calculations through a Preconditioned Block Iterative Eigensolver
- Exponential convergence rates for Batch Normalization: The power of length-direction decoupling in non-convex optimization
- A mixed precision LOBPCG algorithm
- Convergence Analysis of Extended LOBPCG for Computing Extreme Eigenvalues
- Geometric Data Analysis Across Scales via Laplacian Eigenvector Cascading