Bayesian Effect Selection in Structured Additive Distributional Regression Models

Abstract

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional regression. This enables us to model effects on all distributional parameters for arbitrary parametric distributions, and to consider various effect types such as non-linear or spatial effects as well as hierarchical regression structures. Our spike and slab prior relies on a parameter expansion that separates blocks of regression coefficients into overall scalar importance parameters and vectors of standardised coefficients. Hence, we can work with a scalar quantity for effect selection instead of a possibly high-dimensional effect vector, which yields improved shrinkage and sampling performance compared to the classical normal-inverse-gamma prior. We investigate the propriety of the posterior, show that the prior yields desirable shrinkage properties, propose a way of eliciting prior parameters and provide efficient Markov Chain Monte Carlo sampling. Using both simulated and three large-scale data sets, we show that our approach is applicable for data with a potentially large number of covariates, multilevel predictors accounting for hierarchically nested data and non-standard response distributions, such as bivariate normal or zero-inflated Poisson.

References in corpus (9)

• Spike and slab variable selection: Frequentist and Bayesian strategies
• Optimal predictive model selection
• Bayesian linear regression with sparse priors
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
• Bayesian structured additive distributional regression with an application to regional income inequality in Germany
• Bayesian Variable Selection and Estimation for Group Lasso
• Spike-and-Slab Priors for Function Selection in Structured Additive Regression Models
• Conditions for Posterior Contraction in the Sparse Normal Means Problem
• Bayesian Variable Selection for Skewed Heteroscedastic Response

Cited by in corpus (2)

• Truly Multivariate Structured Additive Distributional Regression
• Adaptive shrinkage of smooth functional effects towards a predefined functional subspace