Empirical priors and coverage of posterior credible sets in a sparse normal mean model

Abstract

Bayesian methods provide a natural means for uncertainty quantification, that is, credible sets can be easily obtained from the posterior distribution. But is this uncertainty quantification valid in the sense that the posterior credible sets attain the nominal frequentist coverage probability? This paper investigates the frequentist validity of posterior uncertainty quantification based on a class of empirical priors in the sparse normal mean model. In particular, we show that our marginal posterior credible intervals achieve the nominal frequentist coverage probability under conditions slightly weaker than needed for selection consistency and a Bernstein--von Mises theorem for the full posterior, and numerical investigations suggest that our empirical Bayes method has superior frequentist coverage probability properties compared to other fully Bayes methods.

arXiv comment18 pages, 1 figure. Comments welcome at https://www.researchers.one/article/2018-12-6

References in corpus (19)

• Optimal predictive model selection
• Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
• Bayesian linear regression with sparse priors
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
• General maximum likelihood empirical Bayes estimation of normal means
• Frequentist coverage of adaptive nonparametric Bayesian credible sets
• The Horseshoe Estimator: Posterior Concentration around Nearly Black Vectors
• Calibrating general posterior credible regions
• Contributed Discussion to Uncertainty Quantification for the Horseshoe by Stéphanie van der Pas, Botond Szabó and Aad van der Vaart
• A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing
• Empirical Bayes posterior concentration in sparse high-dimensional linear models
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• Assigning a value to a power likelihood in a general Bayesian model
• Concentration rate and consistency of the posterior under monotonicity constraints
• Data-driven priors and their posterior concentration rates
• Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
• General framework for projection structures
• Bayesian Linear Regression for Multivariate Responses Under Group Sparsity

Cited by in corpus (4)

• A comparison of learning rate selection methods in generalized Bayesian inference
• Gibbs posterior inference on multivariate quantiles
• Data-driven priors and their posterior concentration rates
• Empirical Bayes inference in sparse high-dimensional generalized linear models