Surprising Asymptotic Conical Structure in Critical Sample Eigen-Directions

Abstract

The aim of this paper is to establish several deep theoretical properties of principal component analysis for multiple-component spike covariance models. Our new results reveal a surprising asymptotic conical structure in critical sample eigendirections under the spike models with distinguishable (or indistinguishable) eigenvalues, when the sample size and/or the number of variables (or dimension) tend to infinity. The consistency of the sample eigenvectors relative to their population counterparts is determined by the ratio between the dimension and the product of the sample size with the spike size. When this ratio converges to a nonzero constant, the sample eigenvector converges to a cone, with a certain angle to its corresponding population eigenvector.In the High Dimension, Low Sample Size case, the angle between the sample eigenvector and its population counterpart converges to a limiting distribution.Several generalizations of the multi-spike covariance models are also explored, and additional theoretical results are presented.

References in corpus (4)

• PCA consistency in high dimension, low sample size context
• Distributions of Angles in Random Packing on Spheres
• Convergence and prediction of principal component scores in high-dimensional settings
• Augmented sparse principal component analysis for high dimensional data

Cited by in corpus (14)

• Projected principal component analysis in factor models
• Distributions of Angles in Random Packing on Spheres
• Asymptotics of Empirical Eigen-structure for Ultra-high Dimensional Spiked Covariance Model
• Limiting Laws for Divergent Spiked Eigenvalues and Largest Non-spiked Eigenvalue of Sample Covariance Matrices
• De-biased sparse PCA: Inference and testing for eigenstructure of large covariance matrices
• When and why are principal component scores a good tool for visualizing high-dimensional data?
• An Overview on the Estimation of Large Covariance and Precision Matrices
• Unbounded Largest Eigenvalue of Large Sample Covariance Matrices: Asymptotics, Fluctuations and Applications
• Generalized Four Moment Theorem and an Application to CLT for Spiked Eigenvalues of Large-dimensional Covariance Matrices
• Heterogeneity Adjustment with Applications to Graphical Model Inference
• Joint CLT for top eigenvalues of sample covariance matrices of separable high dimensional long memory processes
• The limits of the sample spiked eigenvalues for a high-dimensional generalized Fisher matrix and its applications
• Generalized Four Moment Theorem with an application to the CLT for the spiked eigenvalues of high-dimensional general Fisher-matrices
• Sparsifying the Fisher Linear Discriminant by Rotation