Ridge Estimation of Inverse Covariance Matrices from High-Dimensional Data

Abstract

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do not coincide with common ridge penalties. Subsequently, starting from a common ridge penalty, analytic expressions are derived for two alternative ridge estimators of the precision matrix. The alternative estimators are compared to the archetypes with regard to eigenvalue shrinkage and risk. The alternatives are also compared to the graphical lasso within the context of graphical modeling. The comparisons may give reason to prefer the proposed alternative estimators.

References in corpus (2)

• Covariance Estimation: The GLM and Regularization Perspectives
• Generalized information criterion for model selection in penalized graphical models

Cited by in corpus (11)

• rags2ridges: A One-Stop-Shop for Graphical Modeling of High-Dimensional Precision Matrices
• A More Robust Approach to Multivariable Mendelian Randomization
• The Spectral Condition Number Plot for Regularization Parameter Determination
• Semi-supervised empirical Bayes group-regularized factor regression
• Graphical Elastic Net and Target Matrices: Fast Algorithms and Software for Sparse Precision Matrix Estimation
• Improving Genomic Prediction using High-dimensional Secondary Phenotypes: the Genetic Latent Factor Approach
• Shrinkage estimation of large covariance matrices using multiple shrinkage targets
• A parallel algorithm for penalized learning of the multivariate exponential family from data of mixed types
• Millisecond Exoplanet Imaging, II: Regression Equations and Technical Discussion
• Incorporating prior information and borrowing information in high-dimensional sparse regression using the horseshoe and variational Bayes
• Paired Test of Matrix Graphs and Brain Connectivity Analysis