Trace Pursuit: A General Framework for Model-Free Variable Selection

Abstract

We propose trace pursuit for model-free variable selection under the sufficient dimension reduction paradigm. Two distinct algorithms are proposed: stepwise trace pursuit and forward trace pursuit. Stepwise trace pursuit achieves selection consistency with fixed p, and is readily applicable in the challenging setting with p>n. Forward trace pursuit can serve as an initial screening step to speed up the computation in the case of ultrahigh dimensionality. The screening consistency property of forward trace pursuit based on sliced inverse regression is established. Finite sample performances of trace pursuit and other model-free variable selection methods are compared through numerical studies.

50 pages

References in corpus (4)

• Nearly unbiased variable selection under minimax concave penalty
• Quantile-adaptive model-free variable screening for high-dimensional heterogeneous data
• Coordinate-independent sparse sufficient dimension reduction and variable selection
• Dimension reduction based on constrained canonical correlation and variable filtering