Inferring causal impact using Bayesian structural time-series models

Abstract

An important problem in econometrics and marketing is to infer the causal impact that a designed market intervention has exerted on an outcome metric over time. This paper proposes to infer causal impact on the basis of a diffusion-regression state-space model that predicts the counterfactual market response in a synthetic control that would have occurred had no intervention taken place. In contrast to classical difference-in-differences schemes, state-space models make it possible to (i) infer the temporal evolution of attributable impact, (ii) incorporate empirical priors on the parameters in a fully Bayesian treatment, and (iii) flexibly accommodate multiple sources of variation, including local trends, seasonality and the time-varying influence of contemporaneous covariates. Using a Markov chain Monte Carlo algorithm for posterior inference, we illustrate the statistical properties of our approach on simulated data. We then demonstrate its practical utility by estimating the causal effect of an online advertising campaign on search-related site visits. We discuss the strengths and limitations of state-space models in enabling causal attribution in those settings where a randomised experiment is unavailable. The CausalImpact R package provides an implementation of our approach.

Published at http://dx.doi.org/10.1214/14-AOAS788 in the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
• Estimating the Causal Effects of Marketing Interventions Using Propensity Score Methodology

Cited by in corpus (16)

• Estimation of Regional Economic Development Indicator from Transportation Network Analytics
• Attribute Extraction from Product Titles in eCommerce
• Measuring Economic Resilience to Natural Disasters with Big Economic Transaction Data
• Dynamic Window-level Granger Causality of Multi-channel Time Series
• Explainable Failure Predictions with RNN Classifiers based on Time Series Data
• Causal inference from observational data: Estimating the effect of contributions on visitation frequency atLinkedIn
• Robust Synthetic Control
• A Self-supervised Approach to Hierarchical Forecasting with Applications to Groupwise Synthetic Controls
• Detecting and Gauging Impact on Wikipedia Page Views
• A review of some recent advances in causal inference
• An adaptive simulated annealing EM algorithm for inference on non-homogeneous hidden Markov models
• The Bayesian Synthetic Control: Improved Counterfactual Estimation in the Social Sciences through Probabilistic Modeling
• Kernel-based Approach to Handle Mixed Data for Inferring Causal Graphs
• Early Detection of Long Term Evaluation Criteria in Online Controlled Experiments
• On Selecting Stable Predictors in Time Series Models
• Structural time series grammar over variable blocks