A scalable saliency-based Feature selection method with instance level information

Abstract

Classic feature selection techniques remove those features that are either irrelevant or redundant, achieving a subset of relevant features that help to provide a better knowledge extraction. This allows the creation of compact models that are easier to interpret. Most of these techniques work over the whole dataset, but they are unable to provide the user with successful information when only instance information is needed. In short, given any example, classic feature selection algorithms do not give any information about which the most relevant information is, regarding this sample. This work aims to overcome this handicap by developing a novel feature selection method, called Saliency-based Feature Selection (SFS), based in deep-learning saliency techniques. Our experimental results will prove that this algorithm can be successfully used not only in Neural Networks, but also under any given architecture trained by using Gradient Descent techniques.

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Scikit-learn: Machine Learning in Python
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• TensorFlow: A system for large-scale machine learning
• Explaining and Harnessing Adversarial Examples
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
• Recurrent Models of Visual Attention
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
• Recovering the number of clusters in data sets with noise features using feature rescaling factors