From controlled to undisciplined data: estimating causal effects in the era of data science using a potential outcome framework

Abstract

This paper discusses the fundamental principles of causal inference - the area of statistics that estimates the effect of specific occurrences, treatments, interventions, and exposures on a given outcome from experimental and observational data. We explain the key assumptions required to identify causal effects, and highlight the challenges associated with the use of observational data. We emphasize that experimental thinking is crucial in causal inference. The quality of the data (not necessarily the quantity), the study design, the degree to which the assumptions are met, and the rigor of the statistical analysis allow us to credibly infer causal effects. Although we advocate leveraging the use of big data and the application of machine learning (ML) algorithms for estimating causal effects, they are not a substitute of thoughtful study design. Concepts are illustrated via examples.

References in corpus (25)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Matching Methods for Causal Inference: A Review and a Look Forward
• For objective causal inference, design trumps analysis
• A Simpler Approach to Matrix Completion
• Matrix Completion Methods for Causal Panel Data Models
• Distinguishing cause from effect using observational data: methods and benchmarks
• Discussion on "Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects" by Hahn, Murray and Carvalho
• On the definition of a confounder
• Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with "Censoring" Due to Death
• Double Machine Learning based Program Evaluation under Unconfoundedness
• On the Validity of Covariate Adjustment for Estimating Causal Effects
• Assessing lack of common support in causal inference using Bayesian nonparametrics: Implications for evaluating the effect of breastfeeding on children's cognitive outcomes
• Exploiting multiple outcomes in Bayesian principal stratification analysis with application to the evaluation of a job training program
• The Probability of Causation
• Complete Graphical Characterization and Construction of Adjustment Sets in Markov Equivalence Classes of Ancestral Graphs
• Overlap in Observational Studies with High-Dimensional Covariates
• A Survey on Causal Inference
• Isolation in the construction of natural experiments
• Atlantic Causal Inference Conference (ACIC) Data Analysis Challenge 2017
• A bracketing relationship between difference-in-differences and lagged-dependent-variable adjustment
• Assessing causal effects in the presence of treatment switching through principal stratification
• Uncertainty in the Design Stage of Two-Stage Bayesian Propensity Score Analysis
• Modelling Network Interference with Multi-valued Treatments: the Causal Effect of Immigration Policy on Crime Rates
• Posterior Predictive Treatment Assignment for Estimating Causal Effects with Limited Overlap
• Assessment of Heterogeneous Treatment Effect Estimation Accuracy via Matching