Optimal rates of convergence for covariance matrix estimation

Abstract

Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet been developed. In this paper we establish the optimal rates of convergence for estimating the covariance matrix under both the operator norm and Frobenius norm. It is shown that optimal procedures under the two norms are different and consequently matrix estimation under the operator norm is fundamentally different from vector estimation. The minimax upper bound is obtained by constructing a special class of tapering estimators and by studying their risk properties. A key step in obtaining the optimal rate of convergence is the derivation of the minimax lower bound. The technical analysis requires new ideas that are quite different from those used in the more conventional function/sequence estimation problems.

Published in at http://dx.doi.org/10.1214/09-AOS752 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (6)

• Regularized estimation of large covariance matrices
• Covariance regularization by thresholding
• Sparse permutation invariant covariance estimation
• The sparsity and bias of the Lasso selection in high-dimensional linear regression
• Sparsistency and rates of convergence in large covariance matrix estimation
• Operator norm consistent estimation of large-dimensional sparse covariance matrices

Cited by in corpus (40)

• Estimation of high-dimensional low-rank matrices
• Sparse PCA: Optimal rates and adaptive estimation
• Optimal detection of sparse principal components in high dimension
• Asymptotic normality and optimalities in estimation of large Gaussian graphical models
• Covariance Estimation: The GLM and Regularization Perspectives
• Optimal rates of convergence for sparse covariance matrix estimation
• Adaptive covariance matrix estimation through block thresholding
• Covariance matrix estimation for stationary time series
• Covariance Estimation in High Dimensions via Kronecker Product Expansions
• Covariance and precision matrix estimation for high-dimensional time series
• Fast and Adaptive Sparse Precision Matrix Estimation in High Dimensions
• Law of Log Determinant of Sample Covariance Matrix and Optimal Estimation of Differential Entropy for High-Dimensional Gaussian Distributions
• Test for bandedness of high-dimensional covariance matrices and bandwidth estimation
• Optimal sparse volatility matrix estimation for high-dimensional Itô processes with measurement errors
• Posterior contraction in sparse Bayesian factor models for massive covariance matrices
• Posterior convergence rates for estimating large precision matrices using graphical models
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
• Statistical analysis of latent generalized correlation matrix estimation in transelliptical distribution
• RascalC: A Jackknife Approach to Estimating Single and Multi-Tracer Galaxy Covariance Matrices
• A penalized empirical likelihood method in high dimensions
• Finite sample change point inference and identification for high-dimensional mean vectors
• Inference for High-dimensional Differential Correlation Matrices
• Optimal Shrinkage Estimator for High-Dimensional Mean Vector
• Detection of correlations
• Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
• Estimation of Toeplitz Covariance Matrices in Large Dimensional Regime with Application to Source Detection
• Introduction to correlation networks: Interdisciplinary approaches beyond thresholding
• Estimation of Large Covariance and Precision Matrices from Temporally Dependent Observations
• Sampling Distributions of Optimal Portfolio Weights and Characteristics in Low and Large Dimensions
• Detecting positive correlations in a multivariate sample
• Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage
• Optimal covariance matrix estimation for high-dimensional noise in high-frequency data
• Tests for covariance matrix with fixed or divergent dimension
• A large covariance matrix estimator under intermediate spikiness regimes
• A Flexible Approach for Predictive Biomarker Discovery
• Estimation of functionals of sparse covariance matrices
• SURE Information Criteria for Large Covariance Matrix Estimation and Their Asymptotic Properties
• Cross-Validated Loss-Based Covariance Matrix Estimator Selection in High Dimensions
• Hub Detection in Gaussian Graphical Models