Deep Generalized Method of Moments for Instrumental Variable Analysis

Abstract

Instrumental variable analysis is a powerful tool for estimating causal effects when randomization or full control of confounders is not possible. The application of standard methods such as 2SLS, GMM, and more recent variants are significantly impeded when the causal effects are complex, the instruments are high-dimensional, and/or the treatment is high-dimensional. In this paper, we propose the DeepGMM algorithm to overcome this. Our algorithm is based on a new variational reformulation of GMM with optimal inverse-covariance weighting that allows us to efficiently control very many moment conditions. We further develop practical techniques for optimization and model selection that make it particularly successful in practice. Our algorithm is also computationally tractable and can handle large-scale datasets. Numerical results show our algorithm matches the performance of the best tuned methods in standard settings and continues to work in high-dimensional settings where even recent methods break.

References in corpus (4)

• Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
• Learning Weighted Representations for Generalization Across Designs
• DeepMatch: Balancing Deep Covariate Representations for Causal Inference Using Adversarial Training
• Adversarial Generalized Method of Moments

Cited by in corpus (17)

• Auto IV: Counterfactual Prediction via Automatic Instrumental Variable Decomposition
• Minimax Estimation of Conditional Moment Models
• Causal Inference Under Unmeasured Confounding With Negative Controls: A Minimax Learning Approach
• Semiparametric proximal causal inference
• Learning Deep Features in Instrumental Variable Regression
• Dual Instrumental Variable Regression
• Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning
• Instrumental Variable Regression via Kernel Maximum Moment Loss
• Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction
• Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning
• Kernel Conditional Moment Test via Maximum Moment Restriction
• A Look into Causal Effects under Entangled Treatment in Graphs: Investigating the Impact of Contact on MRSA Infection
• Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approach
• On Instrumental Variable Regression for Deep Offline Policy Evaluation
• Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation
• General Control Functions for Causal Effect Estimation from Instrumental Variables
• A Class of Algorithms for General Instrumental Variable Models