De-Biased Machine Learning of Global and Local Parameters Using Regularized Riesz Representers

Abstract

We provide adaptive inference methods, based on ${\ell }_1$ regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular functionals include average treatment effects, policy effects, and derivatives conditional on a covariate subvector fixed at a point. We construct a Neyman orthogonal equation for the target parameter that is approximately invariant to small perturbations of the nuisance parameters. To achieve this property, we include the Riesz representer for the functional as an additional nuisance parameter. Our analysis yields weak ``double sparsity robustness'': either the approximation to the regression or the approximation to the representer can be ``completely dense'' as long as the other is sufficiently ``sparse''. Our main results are non-asymptotic and imply asymptotic uniform validity over large classes of models, translating into honest confidence bands for both global and local parameters.

The Econometrics Journal, 2022

Cited by in corpus (11)

• A unifying approach for doubly-robust ${\ell }_1$ regularized estimation of causal contrasts
• Finite Sample Analysis of Minimax Offline Reinforcement Learning: Completeness, Fast Rates and First-Order Efficiency
• Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond
• Debiased Inference of Average Partial Effects in Single-Index Models
• High Dimensional M-Estimation with Missing Outcomes: A Semi-Parametric Framework
• Deep Learning for Individual Heterogeneity
• Debiased Inverse Propensity Score Weighting for Estimation of Average Treatment Effects with High-Dimensional Confounders
• Incremental causal effects
• Knowledge Distillation as Semiparametric Inference
• How well can we learn large factor models without assuming strong factors?
• Causal Inference with Corrupted Data: Measurement Error, Missing Values, Discretization, and Differential Privacy