Measurement Error in Lasso: Impact and Correction

Abstract

Regression with the lasso penalty is a popular tool for performing dimension reduction when the number of covariates is large. In many applications of the lasso, like in genomics, covariates are subject to measurement error. We study the impact of measurement error on linear regression with the lasso penalty, both analytically and in simulation experiments. A simple method of correction for measurement error in the lasso is then considered. In the large sample limit, the corrected lasso yields sign consistent covariate selection under conditions very similar to the lasso with perfect measurements, whereas the uncorrected lasso requires much more stringent conditions on the covariance structure of the data. Finally, we suggest methods to correct for measurement error in generalized linear models with the lasso penalty, which we study empirically in simulation experiments with logistic regression, and also apply to a classification problem with microarray data. We see that the corrected lasso selects less false positives than the standard lasso, at a similar level of true positives. The corrected lasso can therefore be used to obtain more conservative covariate selection in genomic analysis.

References in corpus (3)

• High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
• Orthogonal Matching Pursuit with Noisy and Missing Data: Low and High Dimensional Results
• Keeping greed good: sparse regression under design uncertainty with application to biomass characterization

Cited by in corpus (9)

• Pivotal Estimation via Self-Normalization for High-Dimensional Linear Models with Error in Variables
• Two Stage Non-penalized Corrected Least Squares for High Dimensional Linear Models with Measurement error or Missing Covariates
• High dimensional errors-in-variables models with dependent measurements
• An $\{l_1,l_2,l_{\infty }\}$-Regularization Approach to High-Dimensional Errors-in-variables Models
• Non-separable covariance models for spatio-temporal data, with applications to neural encoding analysis
• Inference in High-Dimensional Linear Measurement Error Models
• Low-rank matrix estimation in multi-response regression with measurement errors: Statistical and computational guarantees
• A Simple Correction Procedure for High-Dimensional Generalized Linear Models with Measurement Error
• Multi-task Learning with High-Dimensional Noisy Images