Estimation of Counterfactual Interventions under Uncertainties

Abstract

Counterfactual analysis is intuitively performed by humans on a daily basis eg. "What should I have done differently to get the loan approved?". Such counterfactual questions also steer the formulation of scientific hypotheses. More formally it provides insights about potential improvements of a system by inferring the effects of hypothetical interventions into a past observation of the system's behaviour which plays a prominent role in a variety of industrial applications. Due to the hypothetical nature of such analysis, counterfactual distributions are inherently ambiguous. This ambiguity is particularly challenging in continuous settings in which a continuum of explanations exist for the same observation. In this paper, we address this problem by following a hierarchical Bayesian approach which explicitly models such uncertainty. In particular, we derive counterfactual distributions for a Bayesian Warped Gaussian Process thereby allowing for non-Gaussian distributions and non-additive noise. We illustrate the properties our approach on a synthetic and on a semi-synthetic example and show its performance when used within an algorithmic recourse downstream task.

References in corpus (19)

• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Tune: A Research Platform for Distributed Model Selection and Training
• Pyro: Deep Universal Probabilistic Programming
• Actionable Recourse in Linear Classification
• On the Identifiability of the Post-Nonlinear Causal Model
• Deep Structural Causal Models for Tractable Counterfactual Inference
• Algorithmic recourse under imperfect causal knowledge: a probabilistic approach
• Algorithmic Recourse: from Counterfactual Explanations to Interventions
• Large sample analysis of the median heuristic
• What Counterfactuals Can Be Tested
• Towards Robust and Reliable Algorithmic Recourse
• Causal structure based root cause analysis of outliers
• Deep End-to-end Causal Inference
• A Causal Perspective on Meaningful and Robust Algorithmic Recourse
• Partial Counterfactual Identification from Observational and Experimental Data
• Robust Counterfactual Explanations for Tree-Based Ensembles
• Representational aspects of depth and conditioning in normalizing flows
• On the Adversarial Robustness of Causal Algorithmic Recourse
• Counterfactual Plans under Distributional Ambiguity