Oracle inequalities for the lasso in the Cox model
arXiv:1306.4847 · doi:10.1214/13-AOS1098
Abstract
We study the absolute penalized maximum partial likelihood estimator in sparse, high-dimensional Cox proportional hazards regression models where the number of time-dependent covariates can be larger than the sample size. We establish oracle inequalities based on natural extensions of the compatibility and cone invertibility factors of the Hessian matrix at the true regression coefficients. Similar results based on an extension of the restricted eigenvalue can be also proved by our method. However, the presented oracle inequalities are sharper since the compatibility and cone invertibility factors are always greater than the corresponding restricted eigenvalue. In the Cox regression model, the Hessian matrix is based on time-dependent covariates in censored risk sets, so that the compatibility and cone invertibility factors, and the restricted eigenvalue as well, are random variables even when they are evaluated for the Hessian at the true regression coefficients. Under mild conditions, we prove that these quantities are bounded from below by positive constants for time-dependent covariates, including cases where the number of covariates is of greater order than the sample size. Consequently, the compatibility and cone invertibility factors can be treated as positive constants in our oracle inequalities.
arXiv commentPublished in at http://dx.doi.org/10.1214/13-AOS1098 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
References in corpus (24)
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- High-dimensional graphs and variable selection with the Lasso
- Simultaneous analysis of Lasso and Dantzig selector
- Nonconcave penalized likelihood with a diverging number of parameters
- On the conditions used to prove oracle results for the Lasso
- The sparsity and bias of the Lasso selection in high-dimensional linear regression
- Lasso-type recovery of sparse representations for high-dimensional data
- High-dimensional generalized linear models and the lasso
- A Unified Framework for High-Dimensional Analysis of M-Estimators with Decomposable Regularizers
- Sparsity oracle inequalities for the Lasso
- Asymptotics for minimisers of convex processes
- Regularization for Cox's proportional hazards model with NP-dimensionality
- The Dantzig selector and sparsity oracle inequalities
- Non-asymptotic Oracle Inequalities for the High-Dimensional Cox Regression via Lasso
- Estimation And Selection Via Absolute Penalized Convex Minimization And Its Multistage Adaptive Applications
Cited by in corpus (16)
- Challenges of Big Data Analysis
- Estimating Treatment Effect under Additive Hazards Models with High-dimensional Covariates
- Structured Estimation in Nonparameteric Cox Model
- Adaptive estimation of the baseline hazard function in the Cox model by model selection, with high-dimensional covariates
- CoxKnockoff: Controlled Feature Selection for the Cox Model Using Knockoffs
- Spectral Analysis of High-dimensional Time Series
- Testing and Confidence Intervals for High Dimensional Proportional Hazards Model
- Sparse estimation in Ising Model via penalized Monte Carlo methods
- The consistency of the Dantzig Selector for Cox's Proportional Hazards Model
- Event History Analysis of Dynamic Communication Networks
- Comparative Review of Modern Competing Risk Methods in High-dimensional Settings
- A provable two-stage algorithm for penalized hazards regression
- Fine-Gray competing risks model with high-dimensional covariates: estimation and Inference
- Two step estimations via the Dantzig selector for models of stochastic processes with high-dimensional parameters
- The Dantzig selector for diffusion processes with covariates
- Variable selection and structure identification for varying coefficient Cox models