Optimal estimation of functionals of high-dimensional mean and covariance matrix

Abstract

Motivated by portfolio allocation and linear discriminant analysis, we consider estimating a functional ${\mu }^T{\mathbf{\Sigma }}^{-1}\mu$ involving both the mean vector $\mu$ and covariance matrix $\mathbf{\Sigma }$. We study the minimax estimation of the functional in the high-dimensional setting where ${\mathbf{\Sigma }}^{-1}\mu$ is sparse. Akin to past works on functional estimation, we show that the optimal rate for estimating the functional undergoes a phase transition between regular parametric rate and some form of high-dimensional estimation rate. We further show that the optimal rate is attained by a carefully designed plug-in estimator based on de-biasing, while a family of naive plug-in estimators are proved to fall short. We further generalize the estimation problem and techniques that allow robust inputs of mean and covariance matrix estimators. Extensive numerical experiments lend further supports to our theoretical results.

References in corpus (17)

• Nearly unbiased variable selection under minimax concave penalty
• Simultaneous analysis of Lasso and Dantzig selector
• Challenges of Big Data Analysis
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• A two-sample test for high-dimensional data with applications to gene-set testing
• Sparse and stable Markowitz portfolios
• High-dimensional classification using features annealed independence rules
• High-dimensional covariance matrix estimation in approximate factor models
• Adaptive covariance matrix estimation through block thresholding
• High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: Risk underestimation
• Minimax estimation of linear and quadratic functionals on sparsity classes
• Nonquadratic estimators of a quadratic functional
• Tests alternative to higher criticism for high-dimensional means under sparsity and column-wise dependence
• Goodness-of-fit testing and quadratic functional estimation from indirect observations
• Adaptive estimation of linear functionals in the convolution model and applications
• Regularized estimation of linear functionals of precision matrices for high-dimensional time series
• High-dimensional Linear Discriminant Analysis: Optimality, Adaptive Algorithm, and Missing Data