A New Bayesian Approach to Robustness Against Outliers in Linear Regression

Abstract

Linear regression is ubiquitous in statistical analysis. It is well understood that conflicting sources of information may contaminate the inference when the classical normality of errors is assumed. The contamination caused by the light normal tails follows from an undesirable effect: the posterior concentrates in an area in between the different sources with a large enough scaling to incorporate them all. The theory of conflict resolution in Bayesian statistics (O'Hagan and Pericchi (2012)) recommends to address this problem by limiting the impact of outliers to obtain conclusions consistent with the bulk of the data. In this paper, we propose a model with super heavy-tailed errors to achieve this. We prove that it is wholly robust, meaning that the impact of outliers gradually vanishes as they move further and further away form the general trend. The super heavy-tailed density is similar to the normal outside of the tails, which gives rise to an efficient estimation procedure. In addition, estimates are easily computed. This is highlighted via a detailed user guide, where all steps are explained through a simulated case study. The performance is shown using simulation. All required code is given.

To appear in Bayesian Analysis

References in corpus (1)

• Robustness to outliers in location-scale parameter model using log-regularly varying distributions

Cited by in corpus (13)

• Robust Bayesian Regression with Synthetic Posterior
• Informed reversible jump algorithms
• Bayesian Modal Regression based on Mixture Distributions
• An asymptotic Peskun ordering and its application to lifted samplers
• Robust Bayesian Modeling of Counts with Zero inflation and Outliers: Theoretical Robustness and Efficient Computation
• Theoretical properties of Bayesian Student-$t$ linear regression
• An approach to robust Bayesian regression in astronomy
• Robustness against conflicting prior information in regression
• Posterior Robustness with Milder Conditions: Contamination Models Revisited
• Bayesian Analysis on Limiting the Student-$t$ Linear Regression Model
• Robust heavy-tailed versions of generalized linear models with applications in actuarial science
• An Approximate Identity Link Function for Bayesian Generalized Linear Models
• A Simple Proof of Posterior Robustness