Optimization-based Causal Estimation from Heterogenous Environments

Abstract

This paper presents a new optimization approach to causal estimation. Given data that contains covariates and an outcome, which covariates are causes of the outcome, and what is the strength of the causality? In classical machine learning (ML), the goal of optimization is to maximize predictive accuracy. However, some covariates might exhibit a non-causal association with the outcome. Such spurious associations provide predictive power for classical ML, but they prevent us from causally interpreting the result. This paper proposes CoCo, an optimization algorithm that bridges the gap between pure prediction and causal inference. CoCo leverages the recently-proposed idea of environments, datasets of covariates/response where the causal relationships remain invariant but where the distribution of the covariates changes from environment to environment. Given datasets from multiple environments-and ones that exhibit sufficient heterogeneity-CoCo maximizes an objective for which the only solution is the causal solution. We describe the theoretical foundations of this approach and demonstrate its effectiveness on simulated and real datasets. Compared to classical ML and existing methods, CoCo provides more accurate estimates of the causal model and more accurate predictions under interventions.

Journal of Machine Learning Research (JMLR). Code at https://github.com/mingzhang-yin/CoCo

References in corpus (23)

• Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
• Invariant Risk Minimization
• Out-of-Distribution Generalization via Risk Extrapolation (REx)
• Identifiability of Gaussian structural equation models with equal error variances
• On Learning Invariant Representation for Domain Adaptation
• Invariant Models for Causal Transfer Learning
• On Causal and Anticausal Learning
• Causality for Machine Learning
• Identifying the consequences of dynamic treatment strategies: A decision-theoretic overview
• Joint Causal Inference from Multiple Contexts
• The Risks of Invariant Risk Minimization
• Towards Causal Representation Learning
• Causal Discovery from Changes
• Out of Distribution Generalization in Machine Learning
• Invariant Causal Prediction for Block MDPs
• Invariant Risk Minimization Games
• Nonlinear Invariant Risk Minimization: A Causal Approach
• Does Invariant Risk Minimization Capture Invariance?
• Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models
• Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix
• The iWildCam 2019 Challenge Dataset
• Invariant Representation Learning for Treatment Effect Estimation
• Meta-Learned Invariant Risk Minimization