Spike-and-Slab Priors for Function Selection in Structured Additive Regression Models

Abstract

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying coefficients, random effects and further regression terms. The large flexibility of structured additive regression makes function selection a challenging and important task, aiming at (1) selecting the relevant covariates, (2) choosing an appropriate and parsimonious representation of the impact of covariates on the predictor and (3) determining the required interactions. We propose a spike-and-slab prior structure for function selection that allows to include or exclude single coefficients as well as blocks of coefficients representing specific model terms. A novel multiplicative parameter expansion is required to obtain good mixing and convergence properties in a Markov chain Monte Carlo simulation approach and is shown to induce desirable shrinkage properties. In simulation studies and with (real) benchmark classification data, we investigate sensitivity to hyperparameter settings and compare performance to competitors. The flexibility and applicability of our approach are demonstrated in an additive piecewise exponential model with time-varying effects for right-censored survival times of intensive care patients with sepsis. Geoadditive and additive mixed logit model applications are discussed in an extensive appendix.

References in corpus (5)

• BART: Bayesian additive regression trees
• Boosting Algorithms: Regularization, Prediction and Model Fitting
• Component selection and smoothing in multivariate nonparametric regression
• Variable selection in nonparametric additive models
• High-dimensional additive modeling

Cited by in corpus (12)

• Bayesian structured additive distributional regression with an application to regional income inequality in Germany
• A Bayesian Time-Varying Effect Model for Behavioral mHealth Data
• Performance of variable and function selection methods for estimating the non-linear health effects of correlated chemical mixtures: a simulation study
• Bayesian Inference in Nonparanormal Graphical Models
• Bayesian Effect Selection in Structured Additive Distributional Regression Models
• Implicit Copulas from Bayesian Regularized Regression Smoothers
• Spike-and-Slab LASSO Generalized Additive Models and Scalable Algorithms for High-Dimensional Data Analysis
• Bayesian semiparametric analysis of multivariate continuous responses, with variable selection
• Uncertainty Quantification for High Dimensional Sparse Nonparametric Additive Models
• Functional and variables selection in extreme value models for regional flood frequency analysis
• A note on auxiliary mixture sampling for Bayesian Poisson models
• Approximate Laplace approximations for scalable model selection