On the number of principal components in high dimensions
arXiv:1708.04981 · doi:10.1093/biomet/asy010
Abstract
We consider the problem of how many components to retain in the application of principal component analysis when the dimension is much higher than the number of observations. To estimate the number of components, we propose to sequentially test skewness of the squared lengths of residual scores that are obtained by removing leading principal components. The residual lengths are asymptotically left-skewed if all principal components with diverging variances are removed, and right-skewed if not. The proposed estimator is shown to be consistent, performs well in high-dimensional simulation studies, and provides reasonable estimates in a number of real data examples.
References in corpus (4)
- PCA consistency in high dimension, low sample size context
- Normal approximation and concentration of spectral projectors of sample covariance
- Estimation of the Number of Spikes, Possibly Equal, in the High-Dimensional Case
- When and why are principal component scores a good tool for visualizing high-dimensional data?