Ultra high dimensional generalized additive model: Unified Theory and Methods
arXiv:2008.06773 · doi:10.1111/sjos.12548
Abstract
Generalized additive model is a powerful statistical learning and predictive modeling tool that has been applied in a wide range of applications. The need of high-dimensional additive modeling is eminent in the context of dealing with high through-put data such as genetic data analysis. In this article, we studied a two step selection and estimation method for ultra high dimensional generalized additive models. The first step applies group lasso on the expanded bases of the functions. With high probability this selects all nonzero functions without having too much over selection. The second step uses adaptive group lasso with any initial estimators, including the group lasso estimator, that satisfies some regular conditions. The adaptive group lasso estimator is shown to be selection consistent with improved convergence rates. Tuning parameter selection is also discussed and shown to select the true model consistently under GIC procedure. The theoretical properties are supported by extensive numerical study.
References in corpus (14)
- Efficient Estimation of Word Representations in Vector Space
- Simultaneous analysis of Lasso and Dantzig selector
- Nonconcave penalized likelihood with a diverging number of parameters
- Sure independence screening in generalized linear models with NP-dimensionality
- Least squares after model selection in high-dimensional sparse models
- Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming
- Variable selection in nonparametric additive models
- High-dimensional additive modeling
- High-dimensional generalized linear models and the lasso
- Tuning parameter selection in high dimensional penalized likelihood
- Rates of convergence of the Adaptive LASSO estimators to the Oracle distribution and higher order refinements by the bootstrap
- Generalized Additive Model Selection
- Sparse-Input Neural Networks for High-dimensional Nonparametric Regression and Classification
- Perturbation Bootstrap in Adaptive Lasso