Supervised Feature Selection via Dependence Estimation

Abstract

We introduce a framework for filtering features that employs the Hilbert-Schmidt Independence Criterion (HSIC) as a measure of dependence between the features and the labels. The key idea is that good features should maximise such dependence. Feature selection for various supervised learning problems (including classification and regression) is unified under this framework, and the solutions can be approximated using a backward-elimination algorithm. We demonstrate the usefulness of our method on both artificial and real world datasets.

9 pages

Cited by in corpus (7)

• Observational Data-Driven Modeling and Optimization of Manufacturing Processes
• Feature Selection via L1-Penalized Squared-Loss Mutual Information
• Effective Discriminative Feature Selection with Non-trivial Solutions
• Unsupervised Feature Selection via Multi-step Markov Transition Probability
• Deep Kernel Learning for Clustering
• Evolving Fuzzy Image Segmentation with Self-Configuration
• Sensitivity Maps of the Hilbert-Schmidt Independence Criterion