Penalized Composite Quasi-Likelihood for Ultrahigh-Dimensional Variable Selection

Abstract

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a data-driven weighted linear combination of convex loss functions, together with weighted $L_1$-penalty. It is completely data-adaptive and does not require prior knowledge of the error distribution. The weighted $L_1$-penalty is used both to ensure the convexity of the penalty term and to ameliorate the bias caused by the $L_1$-penalty. In the setting with dimensionality much larger than the sample size, we establish a strong oracle property of the proposed method that possesses both the model selection consistency and estimation efficiency for the true non-zero coefficients. As specific examples, we introduce a robust method of composite L1-L2, and optimal composite quantile method and evaluate their performance in both simulated and real data examples.

References in corpus (10)

• Pathwise coordinate optimization
• On the adaptive elastic-net with a diverging number of parameters
• One-step sparse estimates in nonconcave penalized likelihood models
• Sure independence screening in generalized linear models with NP-dimensionality
• Composite quantile regression and the oracle Model Selection Theory
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• Nonlinear Models Using Dirichlet Process Mixtures
• SCAD-penalized regression in high-dimensional partially linear models
• Ultrahigh dimensional variable selection: beyond the linear model
• Hierarchical selection of variables in sparse high-dimensional regression

Cited by in corpus (32)

• New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models
• Adaptive robust variable selection
• Regularization for Cox's proportional hazards model with NP-dimensionality
• Endogeneity in high dimensions
• The Lasso for High-Dimensional Regression with a Possible Change-Point
• Nonconcave penalized composite conditional likelihood estimation of sparse Ising models
• Oracle Estimation of a Change Point in High Dimensional Quantile Regression
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models
• A General Framework for Robust Testing and Confidence Regions in High-Dimensional Quantile Regression
• On Semiparametric Exponential Family Graphical Models
• Control of the False Discovery Rate Under Arbitrary Covariance Dependence
• Simultaneous Feature Selection and Outlier Detection with Optimality Guarantees
• Robustness in sparse linear models: relative efficiency based on robust approximate message passing
• High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms
• A Likelihood Ratio Framework for High Dimensional Semiparametric Regression
• Estimation for bivariate quantile varying coefficient model
• High-Dimensional Quantile Regression: Convolution Smoothing and Concave Regularization
• Detangling robustness in high dimensions: composite versus model-averaged estimation
• Sparse Wavelet Estimation in Quantile Regression with Multiple Functional Predictors
• Estimating False Discovery Proportion Under Arbitrary Covariance Dependence
• Wilcoxon-type Multivariate Cluster Elastic Net
• Robust Variable Selection Criteria for the Penalized Regression
• Adaptive elastic net and Separate Selection from Least Squares for ultra-high dimensional regression models
• Independent screening for single-index hazard rate models with ultra-high dimensional features
• Structural Change in Sparsity
• A spatio-temporal model and inference tools for longitudinal count data on multicolor cell growth
• A Global Bias-Correction DC Method for Biased Estimation under Memory Constraint
• Exponentially tilted likelihood inference on growing dimensional unconditional moment models
• Sparse composite likelihood selection
• Penalized regression with multiple loss functions and selection by vote
• Asymptotic Composite Estimation