External Validity: From Do-Calculus to Transportability Across Populations

Abstract

The generalizability of empirical findings to new environments, settings or populations, often called "external validity," is essential in most scientific explorations. This paper treats a particular problem of generalizability, called "transportability," defined as a license to transfer causal effects learned in experimental studies to a new population, in which only observational studies can be conducted. We introduce a formal representation called "selection diagrams" for expressing knowledge about differences and commonalities between populations of interest and, using this representation, we reduce questions of transportability to symbolic derivations in the do-calculus. This reduction yields graph-based procedures for deciding, prior to observing any data, whether causal effects in the target population can be inferred from experimental findings in the study population. When the answer is affirmative, the procedures identify what experimental and observational findings need be obtained from the two populations, and how they can be combined to ensure bias-free transport.

Published in at http://dx.doi.org/10.1214/14-STS486 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org). arXiv admin note: text overlap with arXiv:1312.7485

References in corpus (4)

• A General Algorithm for Deciding Transportability of Experimental Results
• Karl Pearson's meta-analysis revisited
• Counterfactuals and Policy Analysis in Structural Models
• Identification of Conditional Interventional Distributions

Cited by in corpus (25)

• Causality matters in medical imaging
• A Review of Generalizability and Transportability
• Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals
• Causality for Machine Learning
• Causal inference in drug discovery and development
• Transporting Experimental Results with Entropy Balancing
• Simpson's paradox in Covid-19 case fatality rates: a mediation analysis of age-related causal effects
• Causal Inference in Travel Demand Modeling (and the lack thereof)
• Improving efficiency of inference in clinical trials with external control data
• A Calibration Approach to Transportability and Data-Fusion with Observational Data
• Effect heterogeneity and variable selection for standardizing causal effects to a target population
• Causal Etiology of the Research of James M. Robins
• A Unifying Causal Framework for Analyzing Dataset Shift-stable Learning Algorithms
• Target estimands for population-adjusted indirect comparisons
• A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Research
• Causal effect on a target population: a sensitivity analysis to handle missing covariates
• CausalX: Causal Explanations and Block Multilinear Factor Analysis
• Inferring network structure from interventional time-course experiments
• Transporting stochastic direct and indirect effects to new populations
• Towards Causality-Aware Inferring: A Sequential Discriminative Approach for Medical Diagnosis
• Surrogate Outcomes and Transportability
• A Generalizability Score for Aggregate Causal Effect
• Rejoinder: Learning Optimal Distributionally Robust Individualized Treatment Rules
• Sample Observed Effects: Enumeration, Randomization and Generalization
• Causal Deep Learning