The fused Kolmogorov filter: A nonparametric model-free screening method

Abstract

A new model-free screening method called the fused Kolmogorov filter is proposed for high-dimensional data analysis. This new method is fully nonparametric and can work with many types of covariates and response variables, including continuous, discrete and categorical variables. We apply the fused Kolmogorov filter to deal with variable screening problems emerging from a wide range of applications, such as multiclass classification, nonparametric regression and Poisson regression, among others. It is shown that the fused Kolmogorov filter enjoys the sure screening property under weak regularity conditions that are much milder than those required for many existing nonparametric screening methods. In particular, the fused Kolmogorov filter can still be powerful when covariates are strongly dependent on each other. We further demonstrate the superior performance of the fused Kolmogorov filter over existing screening methods by simulations and real data examples.

Published at http://dx.doi.org/10.1214/14-AOS1303 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (6)

• Nearly unbiased variable selection under minimax concave penalty
• Measuring and testing dependence by correlation of distances
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• High-dimensional classification using features annealed independence rules
• A unified approach to model selection and sparse recovery using regularized least squares
• Marginal empirical likelihood and sure independence feature screening

Cited by in corpus (11)

• Model-free Feature Screening and FDR Control with Knockoff Features
• RaSE: A Variable Screening Framework via Random Subspace Ensembles
• The Kendall Interaction Filter for Variable Interaction Screening in Ultra High Dimensional Classification Problems
• BiometricBlender: Ultra-high dimensional, multi-class synthetic data generator to imitate biometric feature space
• Nonparametric Screening under Conditional Strictly Convex Loss for Ultrahigh Dimensional Sparse Data
• Modular Bayes screening for high-dimensional predictors
• Feature space reduction method for ultrahigh-dimensional, multiclass data: Random forest-based multiround screening (RFMS)
• The cumulative Kolmogorov filter for model-free screening in ultrahigh dimensional data
• Data-Driven Random Projection and Screening for High-Dimensional Generalized Linear Models
• Robust Estimation and Variable Selection for the Accelerated Failure Time Model
• Fused Mean-variance Filter for Feature Screening