Causal Effect Variational Autoencoder with Uniform Treatment

Abstract

Domain adaptation and covariate shift are big issues in deep learning and they ultimately affect any causal inference algorithms that rely on deep neural networks. Causal effect variational autoencoder (CEVAE) is trained to predict the outcome given observational treatment data and it suffers from the distribution shift at test time. In this paper, we introduce uniform treatment variational autoencoders (UTVAE) that are trained with uniform treatment distribution using importance sampling and show that using uniform treatment over observational treatment distribution leads to better causal inference by mitigating the distribution shift that occurs from training to test time. We also explore the combination of uniform and observational treatment distributions with inference and generative network training objectives to find a better training procedure for inferring treatment effects. Experimentally, we find that the proposed UTVAE yields better absolute average treatment effect error and precision in the estimation of heterogeneous effect error than the CEVAE on synthetic and IHDP datasets.

References in corpus (11)

• Auto-Encoding Variational Bayes
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Causal Effect Inference with Deep Latent-Variable Models
• Learning Representations for Counterfactual Inference
• Instrumental Variables: An Econometrician's Perspective
• Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithms
• Combining observational and experimental data to find heterogeneous treatment effects
• Multiply Robust Causal Inference with Double Negative Control Adjustment for Categorical Unmeasured Confounding
• Nonparametric identification is not enough, but randomized controlled trials are
• On Identifying Total Effects in the Presence of Latent Variables and Selection bias
• Counterfactual Cross-Validation: Stable Model Selection Procedure for Causal Inference Models