Posterior Robustness with Milder Conditions: Contamination Models Revisited

Abstract

Robust Bayesian linear regression is a classical but essential statistical tool. Although novel robustness properties of posterior distributions have been proved recently under a certain class of error distributions, their sufficient conditions are restrictive and exclude several important situations. In this work, we revisit a classical two-component mixture model for response variables, also known as contamination model, where one component is a light-tailed regression model and the other component is heavy-tailed. The latter component is independent of the regression parameters, which is crucial in proving the posterior robustness. We obtain new sufficient conditions for posterior (non-)robustness and reveal non-trivial robustness results by using those conditions. In particular, we find that even the Student-$t$ error distribution can achieve the posterior robustness in our framework. A numerical study is performed to check the Kullback-Leibler divergence between the posterior distribution based on full data and that based on data obtained by removing outliers.

arXiv comment19 pages, 1 figure

References in corpus (5)

• A New Bayesian Approach to Robustness Against Outliers in Linear Regression
• Robustness to outliers in location-scale parameter model using log-regularly varying distributions
• Robust and Accurate Inference via a Mixture of Gaussian and Student's t Errors
• Robust Bayesian Modeling of Counts with Zero inflation and Outliers: Theoretical Robustness and Efficient Computation
• Theoretical properties of Bayesian Student-$t$ linear regression

Cited by in corpus (1)

• An approach to robust Bayesian regression in astronomy