Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior

Abstract

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity, determining if parameters associated with correlated predictors should be shrunk together or kept apart. Under suitable conditions, we prove that this empirical Bayes posterior concentrates around the true sparse parameter at the optimal rate asymptotically. A simplified version of a shotgun stochastic search algorithm is employed to implement the variable selection procedure, and we show, via simulation experiments across different settings and a real-data application, the favorable performance of the proposed method compared to existing methods.

25 pages, 4 figures, 2 tables

References in corpus (2)

• Nearly unbiased variable selection under minimax concave penalty
• Bayesian variable selection with shrinking and diffusing priors

Cited by in corpus (5)

• Empirical priors and coverage of posterior credible sets in a sparse normal mean model
• Variational approximations of empirical Bayes posteriors in high-dimensional linear models
• Empirical priors for prediction in sparse high-dimensional linear regression
• Concentration of a sparse Bayesian model with Horseshoe prior in estimating high-dimensional precision matrix
• Strategic Bayesian Asset Allocation