Adapting Neural Networks for the Estimation of Treatment Effects

Abstract

This paper addresses the use of neural networks for the estimation of treatment effects from observational data. Generally, estimation proceeds in two stages. First, we fit models for the expected outcome and the probability of treatment (propensity score) for each unit. Second, we plug these fitted models into a downstream estimator of the effect. Neural networks are a natural choice for the models in the first step. The question we address is: how can we adapt the design and training of the neural networks used in the first step in order to improve the quality of the final estimate of the treatment effect? We propose two adaptations based on insights from the statistical literature on the estimation of treatment effects. The first is a new architecture, the Dragonnet, that exploits the sufficiency of the propensity score for estimation adjustment. The second is a regularization procedure, targeted regularization, that induces a bias towards models that have non-parametrically optimal asymptotic properties `out-of-the-box`. Studies on benchmark datasets for causal inference show these adaptations outperform existing methods. Code is available at github.com/claudiashi57/dragonnet.

References in corpus (7)

• Causal Effect Inference with Deep Latent-Variable Models
• Learning Representations for Counterfactual Inference
• Estimating individual treatment effect: generalization bounds and algorithms
• Perfect Match: A Simple Method for Learning Representations For Counterfactual Inference With Neural Networks
• Deep Counterfactual Networks with Propensity-Dropout
• Benchmarking Framework for Performance-Evaluation of Causal Inference Analysis
• Counterfactual Reasoning and Learning Systems

Cited by in corpus (6)

• Adapting Text Embeddings for Causal Inference
• Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effects
• Targeting customers under response-dependent costs
• Invariant Representation Learning for Treatment Effect Estimation
• Robust Recursive Partitioning for Heterogeneous Treatment Effects with Uncertainty Quantification
• Causal Forecasting:Generalization Bounds for Autoregressive Models