Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants
arXiv:1806.03430
Abstract
Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA and its variants such as sparse PCA and stable PCA can be formulated as optimization problems with exploitable special structures. Many specialized efficient optimization methods have been proposed to solve robust PCA and related problems. In this paper we review existing optimization methods for solving convex and nonconvex relaxations/variants of robust PCA, discuss their advantages and disadvantages, and elaborate on their convergence behaviors. We also provide some insights for possible future research directions including new algorithmic frameworks that might be suitable for implementing on multi-processor setting to handle large-scale problems.
arXiv commentto appear in Proceedings of the IEEE
References in corpus (15)
- Robust Recovery of Subspace Structures by Low-Rank Representation
- Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization
- The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices
- A Gradient Descent Algorithm on the Grassman Manifold for Matrix Completion
- Robust PCA via Outlier Pursuit
- Optimal Algorithms for -subspace Signal Processing
- Fast Algorithms for Robust PCA via Gradient Descent
- Scalable Robust Matrix Recovery: Frank-Wolfe Meets Proximal Methods
- Stable Principal Component Pursuit
- A variational approach to stable principal component pursuit
- Variational properties of value functions
- Efficient Background Modeling Based on Sparse Representation and Outlier Iterative Removal
- Fast First-Order Methods for Stable Principal Component Pursuit
- Robust Principal Component Analysis on Graphs
- Low-Rank Matrix Completion using Nuclear Norm with Facial Reduction