Interaction pursuit in high-dimensional multi-response regression via distance correlation
arXiv:1605.03315
Abstract
Feature interactions can contribute to a large proportion of variation in many prediction models. In the era of big data, the coexistence of high dimensionality in both responses and covariates poses unprecedented challenges in identifying important interactions. In this paper, we suggest a two-stage interaction identification method, called the interaction pursuit via distance correlation (IPDC), in the setting of high-dimensional multi-response interaction models that exploits feature screening applied to transformed variables with distance correlation followed by feature selection. Such a procedure is computationally efficient, generally applicable beyond the heredity assumption, and effective even when the number of responses diverges with the sample size. Under mild regularity conditions, we show that this method enjoys nice theoretical properties including the sure screening property, support union recovery, and oracle inequalities in prediction and estimation for both interactions and main effects. The advantages of our method are supported by several simulation studies and real data analysis.
arXiv commentto appear in The Annals of Statistics (2016)
References in corpus (7)
- Simultaneous analysis of Lasso and Dantzig selector
- Support union recovery in high-dimensional multivariate regression
- Bayesian variable selection with shrinking and diffusing priors
- Structured variable selection and estimation
- Innovated interaction screening for high-dimensional nonlinear classification
- A fast algorithm for detecting gene-gene interactions in genome-wide association studies
- Interaction Pursuit with Feature Screening and Selection