Bayesian High-dimensional Semi-parametric Inference beyond sub-Gaussian Errors

Abstract

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally $\beta$-Hölder class with an exponentially decreasing tail, which does not need to be sub-Gaussian. We obtain posterior convergence rates of the regression coefficient and the error density, which are nearly optimal and adaptive to the unknown sparsity level. Furthermore, we derive the semi-parametric Bernstein-von Mises (BvM) theorem to characterize asymptotic shape of the marginal posterior for regression coefficients. Under the sub-Gaussianity assumption on the true score function, strong model selection consistency for regression coefficients are also obtained, which eventually asserts the frequentist's validity of credible sets.

References in corpus (10)

• Simultaneous analysis of Lasso and Dantzig selector
• On the conditions used to prove oracle results for the Lasso
• Bayesian variable selection with shrinking and diffusing priors
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
• Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
• On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
• Nearly optimal Bayesian Shrinkage for High Dimensional Regression
• Scalable Bayesian Variable Selection Using Nonlocal Prior Densities in Ultrahigh-Dimensional Settings
• Bayesian Sparse Linear Regression with Unknown Symmetric Error
• Posterior Asymptotic Normality for an Individual Coordinate in High-dimensional Linear Regression