Dual Principal Component Pursuit
arXiv:1510.04390
Abstract
We consider the problem of learning a linear subspace from data corrupted by outliers. Classical approaches are typically designed for the case in which the subspace dimension is small relative to the ambient dimension. Our approach works with a dual representation of the subspace and hence aims to find its orthogonal complement; as such, it is particularly suitable for subspaces whose dimension is close to the ambient dimension (subspaces of high relative dimension). We pose the problem of computing normal vectors to the inlier subspace as a non-convex minimization problem on the sphere, which we call Dual Principal Component Pursuit (DPCP) problem. We provide theoretical guarantees under which every global solution to DPCP is a vector in the orthogonal complement of the inlier subspace. Moreover, we relax the non-convex DPCP problem to a recursion of linear programs whose solutions are shown to converge in a finite number of steps to a vector orthogonal to the subspace. In particular, when the inlier subspace is a hyperplane, the solutions to the recursion of linear programs converge to the global minimum of the non-convex DPCP problem in a finite number of steps. We also propose algorithms based on alternating minimization and iteratively re-weighted least squares, which are suitable for dealing with large-scale data. Experiments on synthetic data show that the proposed methods are able to handle more outliers and higher relative dimensions than current state-of-the-art methods, while experiments in the context of the three-view geometry problem in computer vision suggest that the proposed methods can be a useful or even superior alternative to traditional RANSAC-based approaches for computer vision and other applications.
arXiv commentfixed two typos in section 7.3
References in corpus (11)
- Quantum principal component analysis
- A geometric analysis of subspace clustering with outliers
- Complete Dictionary Recovery over the Sphere I: Overview and the Geometric Picture
- Coherence Pursuit: Fast, Simple, and Robust Principal Component Analysis
- Complete Dictionary Recovery over the Sphere II: Recovery by Riemannian Trust-region Method
- Distributing many points on spheres: minimal energy and designs
- Exact Recovery of Sparsely-Used Dictionaries
- A Novel M-Estimator for Robust PCA
- Fast, Robust and Non-convex Subspace Recovery
- The ideal of the trifocal variety
- lp-Recovery of the Most Significant Subspace among Multiple Subspaces with Outliers