Posterior convergence rates for estimating large precision matrices using graphical models

Abstract

We consider Bayesian estimation of a $p\times p$ precision matrix, when $p$ can be much larger than the available sample size $n$. It is well known that consistent estimation in such ultra-high dimensional situations requires regularization such as banding, tapering or thresholding. We consider a banding structure in the model and induce a prior distribution on a banded precision matrix through a Gaussian graphical model, where an edge is present only when two vertices are within a given distance. For a proper choice of the order of graph, we obtain the convergence rate of the posterior distribution and Bayes estimators based on the graphical model in the $L_{\infty }$-operator norm uniformly over a class of precision matrices, even if the true precision matrix may not have a banded structure. Along the way to the proof, we also compute the convergence rate of the maximum likelihood estimator (MLE) under the same set of condition, which is of independent interest. The graphical model based MLE and Bayes estimators are automatically positive definite, which is a desirable property not possessed by some other estimators in the literature. We also conduct a simulation study to compare finite sample performance of the Bayes estimators and the MLE based on the graphical model with that obtained by using a Cholesky decomposition of the precision matrix. Finally, we discuss a practical method of choosing the order of the graphical model using the marginal likelihood function.

References in corpus (9)

• Regularized estimation of large covariance matrices
• Covariance regularization by thresholding
• Sparse permutation invariant covariance estimation
• Optimal rates of convergence for covariance matrix estimation
• Operator norm consistent estimation of large-dimensional sparse covariance matrices
• Adaptive covariance matrix estimation through block thresholding
• Wishart distributions for decomposable graphs
• Flexible covariance estimation in graphical Gaussian models
• Posterior contraction in sparse Bayesian factor models for massive covariance matrices

Cited by in corpus (21)

• A General Framework for Bayes Structured Linear Models
• Rate-optimal posterior contraction for sparse PCA
• Bayesian Inference in Nonparanormal Graphical Models
• The Graphical Horseshoe Estimator for Inverse Covariance Matrices
• An empirical $G$-Wishart prior for sparse high-dimensional Gaussian graphical models
• Optimal Bayesian estimation in stochastic block models
• Covariance Matrix Estimation for High-Throughput Biomedical Data with Interconnected Communities
• Posterior Graph Selection and Estimation Consistency for High-dimensional Bayesian DAG Models
• Bayes Regularized Graphical Model Estimation in High Dimensions
• An approach to large-scale Quasi-Bayesian inference with spike-and-slab priors
• Bayesian Graph Selection Consistency Under Model Misspecification
• A Bayesian Approach to Joint Estimation of Multiple Graphical Models
• Oracle posterior contraction rates under hierarchical priors
• B-CONCORD -- A scalable Bayesian high-dimensional precision matrix estimation procedure
• Minimax Posterior Convergence Rates and Model Selection Consistency in High-dimensional DAG Models based on Sparse Cholesky Factors
• Bayesian variable selection in linear regression models with instrumental variables
• Bayesian Nonparametric Graph Clustering
• Consistent Bayesian Sparsity Selection for High-dimensional Gaussian DAG Models with Multiplicative and Beta-mixture Priors
• Posterior consistency in multi-response regression models with non-informative priors for the error covariance matrix in growing dimensions
• Bayesian Bandwidth Test and Selection for High-dimensional Banded Precision Matrices
• Bayesian estimation of a sparse precision matrix