Robust Principal Components by Casewise and Cellwise Weighting

Abstract

Principal component analysis (PCA) is a fundamental tool for analyzing multivariate data. Here the focus is on dimension reduction to the principal subspace, characterized by its projection matrix. The classical principal subspace can be strongly affected by the presence of outliers. Traditional robust approaches consider casewise outliers, that is, cases generated by an unspecified outlier distribution that differs from that of the clean cases. But there may also be cellwise outliers, which are suspicious entries that can occur anywhere in the data matrix. Another common issue is that some cells may be missing. This paper proposes a new robust PCA method, called cellPCA, that can simultaneously deal with casewise outliers, cellwise outliers, and missing cells. Its single objective function combines two robust loss functions, that together mitigate the effect of casewise and cellwise outliers. The objective function is minimized by an iteratively reweighted least squares (IRLS) algorithm. Residual cellmaps and enhanced outlier maps are proposed for outlier detection. The casewise and cellwise influence functions of the principal subspace are derived, and its asymptotic distribution is obtained. Extensive simulations and two real data examples illustrate the performance of cellPCA.

References in corpus (11)

• Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery
• Propagation of outliers in multivariate data
• Detecting deviating data cells
• Fast robust correlation for high-dimensional data
• MacroPCA: An all-in-one PCA method allowing for missing values as well as cellwise and rowwise outliers
• The shooting S-estimator for robust regression
• The Cellwise Minimum Covariance Determinant Estimator
• Challenges of cellwise outliers
• Robust Multivariate Functional Control Chart
• Handling cellwise outliers by sparse regression and robust covariance
• Cellwise outlier detection in heterogeneous populations