Statistical eigen-inference from large Wishart matrices

Abstract

We consider settings where the observations are drawn from a zero-mean multivariate (real or complex) normal distribution with the population covariance matrix having eigenvalues of arbitrary multiplicity. We assume that the eigenvectors of the population covariance matrix are unknown and focus on inferential procedures that are based on the sample eigenvalues alone (i.e., "eigen-inference"). Results found in the literature establish the asymptotic normality of the fluctuation in the trace of powers of the sample covariance matrix. We develop concrete algorithms for analytically computing the limiting quantities and the covariance of the fluctuations. We exploit the asymptotic normality of the trace of powers of the sample covariance matrix to develop eigenvalue-based procedures for testing and estimation. Specifically, we formulate a simple test of hypotheses for the population eigenvalues and a technique for estimating the population eigenvalues in settings where the cumulative distribution function of the (nonrandom) population eigenvalues has a staircase structure. Monte Carlo simulations are used to demonstrate the superiority of the proposed methodologies over classical techniques and the robustness of the proposed techniques in high-dimensional, (relatively) small sample size settings. The improved performance results from the fact that the proposed inference procedures are "global" (in a sense that we describe) and exploit "global" information thereby overcoming the inherent biases that cripple classical inference procedures which are "local" and rely on "local" information.

Published in at http://dx.doi.org/10.1214/07-AOS583 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (8)

• Level-Spacing Distributions and the Airy Kernel
• On Orthogonal and Symplectic Matrix Ensembles
• Level-Spacing Distributions and the Airy Kernel
• Tracy--Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
• Second Order Freeness and Fluctuations of Random Matrices: II. Unitary Random Matrices
• Second Order Freeness and Fluctuations of Random Matrices, III. Higher order freeness and free cumulants
• Spectrum estimation for large dimensional covariance matrices using random matrix theory
• MOPS: Multivariate Orthogonal Polynomials (symbolically)

Cited by in corpus (21)

• Covariance Estimation in High Dimensions via Kronecker Product Expansions
• Concentration of measure and spectra of random matrices: Applications to correlation matrices, elliptical distributions and beyond
• Convergence and prediction of principal component scores in high-dimensional settings
• Eigen-Inference for Energy Estimation of Multiple Sources
• From synaptic interactions to collective dynamics in random neuronal networks models: critical role of eigenvectors and transient behavior
• Convolution operations arising from Vandermonde matrices
• Second Order Cumulants of products
• On a symbolic representation of non-central Wishart random matrices with applications
• Performance of Statistical Tests for Single Source Detection using Random Matrix Theory
• Estimation of the population spectral distribution from a large dimensional sample covariance matrix
• The Non-Commutative Cycle Lemma
• Eigenvalue distributions of variance components estimators in high-dimensional random effects models
• Signal from noise retrieval from one and two-point Green's function - comparison
• A shrinkage estimation for large dimensional precision matrices using random matrix theory
• A local moment estimator of the spectrum of a large dimensional covariance matrix
• Maximal Invariants Over Symmetric Cones
• Fast randomized numerical rank estimation for numerically low-rank matrices
• Eigenvector overlaps in large sample covariance matrices and nonlinear shrinkage estimators
• On spectral properties of high-dimensional spatial-sign covariance matrices in elliptical distributions with applications
• Test of Independence for High-dimensional Random Vectors Based on Block Correlation Matrices
• Numerical Implementation of the QuEST Function