Estimating the principal components of correlation matrices from all their empirical eigenvectors
arXiv:1503.00287 · doi:10.1209/0295-5075/112/50001
Abstract
We consider the problem of estimating the principal components of a population correlation matrix from a limited number of measurement data. Using a combination of random matrix and information-theoretic tools, we show that all the eigenmodes of the sample correlation matrices are informative, and not only the top ones. We show how this information can be exploited when prior information about the principal component, such as whether it is localized or not, is available by mapping the estimation problem onto the search for the ground state of a spin-glass-like effective Hamiltonian encoding the prior. Results are illustrated numerically on the spiked covariance model.
arXiv comment6 pages, 6 figures, to appear in Europhysics Letters
References in corpus (8)
- Noise Dressing of Financial Correlation Matrices
- Large Deviations of Extreme Eigenvalues of Random Matrices
- Finite sample approximation results for principal component analysis: a matrix perturbation approach
- From principal component to direct coupling analysis of coevolution in proteins: Low-eigenvalue modes are needed for structure prediction
- Phonons in two-dimensional soft colloidal crystals
- Eigenvector dynamics: general theory and some applications
- High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections
- Sampling eigenmodes in colloidal solids
Cited by in corpus (8)
- Cleaning large correlation matrices: tools from random matrix theory
- Constrained Low-rank Matrix Estimation: Phase Transitions, Approximate Message Passing and Applications
- Statistical Physics and Representations in Real and Artificial Neural Networks
- On the overlaps between eigenvectors of correlated random matrices
- Top Eigenpair Statistics for Weighted Sparse Graphs
- Resummed mean-field inference for strongly coupled data
- Top eigenpair statistics of diluted Wishart matrices
- A Consistently Oriented Basis for Eigenanalysis: Improved Directional Statistics