Consistency of objective Bayes factors as the model dimension grows

Abstract

In the class of normal regression models with a finite number of regressors, and for a wide class of prior distributions, a Bayesian model selection procedure based on the Bayes factor is consistent [Casella and Moreno J. Amer. Statist. Assoc. 104 (2009) 1261--1271]. However, in models where the number of parameters increases as the sample size increases, properties of the Bayes factor are not totally understood. Here we study consistency of the Bayes factors for nested normal linear models when the number of regressors increases with the sample size. We pay attention to two successful tools for model selection [Schwarz Ann. Statist. 6 (1978) 461--464] approximation to the Bayes factor, and the Bayes factor for intrinsic priors [Berger and Pericchi J. Amer. Statist. Assoc. 91 (1996) 109--122, Moreno, Bertolino and Racugno J. Amer. Statist. Assoc. 93 (1998) 1451--1460]. We find that the the Schwarz approximation and the Bayes factor for intrinsic priors are consistent when the rate of growth of the dimension of the bigger model is $O(n^b)$ for $b<1$. When $b=1$ the Schwarz approximation is always inconsistent under the alternative while the Bayes factor for intrinsic priors is consistent except for a small set of alternative models which is characterized.

Published in at http://dx.doi.org/10.1214/09-AOS754 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Consistency of Bayesian procedures for variable selection

Cited by in corpus (26)

• Bayesian variable selection with shrinking and diffusing priors
• Bayesian model choice and information criteria in sparse generalized linear models
• Bayesian Model Selection Based on Proper Scoring Rules
• Posterior Model Consistency in Variable Selection as the Model Dimension Grows
• Bayes factor consistency
• Bayesian model comparison with the Hyvärinen score: computation and consistency
• The Whetstone and the Alum Block: Balanced Objective Bayesian Comparison of Nested Models for Discrete Data
• A Bayes factor with reasonable model selection consistency for ANOVA model
• Necessary and Sufficient Conditions for High-Dimensional Posterior Consistency under $g$-Priors
• Model Selection and Multiple Testing - A Bayesian and Empirical Bayes Overview and some New Results
• The matryoshka doll prior: principled multiplicity correction in Bayesian model comparison
• Consistency of Bayes factor for nonnested model selection when the model dimension grows
• A Fast and Scalable Joint Estimator for Learning Multiple Related Sparse Gaussian Graphical Models
• Objective Bayesian Comparison of Constrained Analysis of Variance Models
• Complexity analysis of Bayesian learning of high-dimensional DAG models and their equivalence classes
• Consistency of Bayes factors for linear models
• Bayesian Ultrahigh-Dimensional Screening Via MCMC
• Two discussions of the paper "Bayesian measures of model complexity and fit" by D. Spiegelhalter et al., Read before The Royal Statistical Society at a meeting organized by the Research Section on Wednesday, March 13th, 2002
• Linear regression model selection using p-values when the model dimension grows
• Consistency of Bayesian Linear Model Selection With a Growing Number of Parameters
• Revisiting High Dimensional Bayesian Model Selection for Gaussian Regression
• An Application of Bayesian Variable Selection to Spatial Concurrent Linear Models
• Bayesian Bandwidth Test and Selection for High-dimensional Banded Precision Matrices
• Error and Inference: an outsider stand on a frequentist philosophy
• A Mixture of g-priors for Variable Selection when the Number of Regressors Grows with the Sample Size
• Bayes Factor Consistency for Unbalanced ANOVA Models