Feature Selection: A Data Perspective

Abstract

Feature selection, as a data preprocessing strategy, has been proven to be effective and efficient in preparing data (especially high-dimensional data) for various data mining and machine learning problems. The objectives of feature selection include: building simpler and more comprehensible models, improving data mining performance, and preparing clean, understandable data. The recent proliferation of big data has presented some substantial challenges and opportunities to feature selection. In this survey, we provide a comprehensive and structured overview of recent advances in feature selection research. Motivated by current challenges and opportunities in the era of big data, we revisit feature selection research from a data perspective and review representative feature selection algorithms for conventional data, structured data, heterogeneous data and streaming data. Methodologically, to emphasize the differences and similarities of most existing feature selection algorithms for conventional data, we categorize them into four main groups: similarity based, information theoretical based, sparse learning based and statistical based methods. To facilitate and promote the research in this community, we also present an open-source feature selection repository that consists of most of the popular feature selection algorithms (\url{http://featureselection.asu.edu/}). Also, we use it as an example to show how to evaluate feature selection algorithms. At the end of the survey, we present a discussion about some open problems and challenges that require more attention in future research.

References in corpus (1)

• Scikit-learn: Machine Learning in Python

Cited by in corpus (51)

• Building an Efficient Intrusion Detection System Based on Feature Selection and Ensemble Classifier
• IGRF-RFE: A Hybrid Feature Selection Method for MLP-based Network Intrusion Detection on UNSW-NB15 Dataset
• Multi-Stage Optimized Machine Learning Framework for Network Intrusion Detection
• A Survey of Learning Causality with Data: Problems and Methods
• Topology comparison of Twitter diffusion networks effectively reveals misleading information
• Redundancy Coefficient Gradual Up-weighting-based Mutual Information Feature Selection Technique for Crypto-ransomware Early Detection
• Machine learning methods for prediction of cancer driver genes: a survey paper
• High-Order Conditional Mutual Information Maximization for dealing with High-Order Dependencies in Feature Selection
• Data Readiness for AI: A 360-Degree Survey
• Curvature-based Feature Selection with Application in Classifying Electronic Health Records
• Determining the severity of Parkinson's disease in patients using a multi task neural network
• MixupExplainer: Generalizing Explanations for Graph Neural Networks with Data Augmentation
• Multi-omics data integration for early diagnosis of hepatocellular carcinoma (HCC) using machine learning
• DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systems
• Feature Selection: A perspective on inter-attribute cooperation
• A-SFS: Semi-supervised Feature Selection based on Multi-task Self-supervision
• A feature selection method based on Shapley values robust to concept shift in regression
• Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints
• Leveraging Model Inherent Variable Importance for Stable Online Feature Selection
• A Similarity Approach to Cities and Features
• Preference Disaggregation Analysis with Criteria Selection in a Regularization Framework
• LLpowershap: Logistic Loss-based Automated Shapley Values Feature Selection Method
• Improving Pre-movement Pattern Detection with Filter Bank Selection
• Information-theoretic Feature Selection via Tensor Decomposition and Submodularity
• The Backbone Method for Ultra-High Dimensional Sparse Machine Learning
• Turning Noises to Fingerprint-Free "Credentials": Secure and Usable Drone Authentication
• Universal Feature Selection Tool (UniFeat): An Open-Source Tool for Dimensionality Reduction
• A novel feature selection framework for incomplete data
• Iterative missing value imputation based on feature importance
• Tensor-based Multimodal Learning for Prediction of Pulmonary Arterial Wedge Pressure from Cardiac MRI
• Interpretable Classification of Bacterial Raman Spectra with Knockoff Wavelets
• Nonlinear input feature reduction for data-based physical modeling
• PassAI: explainable artificial intelligence algorithm for soccer pass analysis using multimodal information resources
• Effect sizes as a statistical feature-selector-based learning to detect breast cancer
• Guidance Source Matters: How Guidance from AI, Expert, or a Group of Analysts Impacts Visual Data Preparation and Analysis
• A Plant Root System Algorithm Based on Swarm Intelligence for One-dimensional Biomedical Signal Feature Engineering
• Is Your Explanation Reliable: Confidence-Aware Explanation on Graph Neural Networks
• Using Constraints to Discover Sparse and Alternative Subgroup Descriptions
• Efficiently Estimating Mutual Information Between Attributes Across Tables
• Mixed Data Clustering Survey and Challenges
• Multi-label feature selection based on binary hashing learning and dynamic graph constraints
• Microphone Subset Selection for the Weighted Prediction Error Algorithm using a Group Sparsity Penalty
• Variable Selection Using Relative Importance Rankings
• Feedback-Based Dynamic Feature Selection for Constrained Continuous Data Acquisition
• Finding Optimal Diverse Feature Sets with Alternative Feature Selection
• High-Accuracy Material Classification via Reference-Free Terahertz Spectroscopy: Revisiting Spectral Referencing and Feature Selection
• Unsupervised Feature Ranking via Attribute Networks
• Approaches to Improving the Accuracy of Machine Learning Models in Requirements Elicitation Techniques Selection
• INTELLECT: Adapting Cyber Threat Detection to Heterogeneous Computing Environments
• Orthogonal Least Squares Based Fast Feature Selection for Linear Classification
• Cause-and-effect approach to turbulence forecasting