Endogeneity in high dimensions

Abstract

Most papers on high-dimensional statistics are based on the assumption that none of the regressors are correlated with the regression error, namely, they are exogenous. Yet, endogeneity can arise incidentally from a large pool of regressors in a high-dimensional regression. This causes the inconsistency of the penalized least-squares method and possible false scientific discoveries. A necessary condition for model selection consistency of a general class of penalized regression methods is given, which allows us to prove formally the inconsistency claim. To cope with the incidental endogeneity, we construct a novel penalized focused generalized method of moments (FGMM) criterion function. The FGMM effectively achieves the dimension reduction and applies the instrumental variable methods. We show that it possesses the oracle property even in the presence of endogenous predictors, and that the solution is also near global minimum under the over-identification assumption. Finally, we also show how the semi-parametric efficiency of estimation can be achieved via a two-step approach.

Published in at http://dx.doi.org/10.1214/13-AOS1202 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (14)

• Nearly unbiased variable selection under minimax concave penalty
• On the adaptive elastic-net with a diverging number of parameters
• An MCMC Approach to Classical Estimation
• One-step sparse estimates in nonconcave penalized likelihood models
• Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• The sparsity and bias of the Lasso selection in high-dimensional linear regression
• High-dimensional generalized linear models and the lasso
• Nonparametric methods for inference in the presence of instrumental variables
• High-dimensional variable selection
• A unified approach to model selection and sparse recovery using regularized least squares
• Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator
• L1-Penalization for Mixture Regression Models
• Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima

Cited by in corpus (17)

• Smoothed estimating equations for instrumental variables quantile regression
• Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics
• High dimensional generalized empirical likelihood for moment restrictions with dependent data
• Are Discoveries Spurious? Distributions of Maximum Spurious Correlations and Their Applications
• Minimax Estimation of Conditional Moment Models
• Non-Concave Penalization in Linear Mixed-Effects Models and Regularized Selection of Fixed Effects
• Confidence Intervals for Causal Effects with Invalid Instruments using Two-Stage Hard Thresholding with Voting
• Integrating multi-source block-wise missing data in model selection
• An efficient and robust approach to Mendelian randomization with measured pleiotropic effects in a high-dimensional setting
• Environment Invariant Linear Least Squares
• Online Weak-form Sparse Identification of Partial Differential Equations
• Culling the herd of moments with penalized empirical likelihood
• Adaptive MCMC for Generalized Method of Moments with Many Moment Conditions
• Bayesian Variable Selection in Double Generalized Linear Tweedie Spatial Process Models
• Bayesian variable selection in linear regression models with instrumental variables
• Testing Endogeneity with High Dimensional Covariates
• Heterogeneous Endogenous Effects in Networks