Assessing feature scorer results on high-dimensional datasets with t-SNE

Abstract

While vast literature on high-dimensional data visualization is available, there are not many works regarding the visualization of feature scorers and their results. Feature scorers are algorithms that assign numerical importance to each feature of multi-dimensional datasets. These importance scores can be used in several applications, such as feature selection, knowledge discovery, and machine learning interpretability. There are several feature scorers to choose from, and often no single metric or ground truth is available to guarantee the quality of their results. In this scenario, visualization can become valuable to support the decision of which method to choose and how good its results are. For this goal, this work presents "weighted t-SNE." It modifies the relationship between data points in the embedded 2D space to reflect the importance of each dimension of the original datasets as assessed by a feature scorer. This research discusses how to implement weighted t-SNE, proposes the silhouette coefficient as a numerical evaluation of the results, and shows several examples of its use in practice. Synthetic and real-world tabular datasets are used in the experiments together with nine feature scorers, ranging from Mutual Information to neural networks. Each feature scorer produces unique visualizations, and weighted t-SNE can be used to compare and choose the one that better suits a given dataset and task. Weighted t-SNE can also visually show the importance of features learned by machine learning models and help us see how they are organizing the data, increasing their interpretability.

References in corpus (16)

• Scikit-learn: Machine Learning in Python
• Array Programming with NumPy
• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• Methods for Interpreting and Understanding Deep Neural Networks
• Learning Important Features Through Propagating Activation Differences
• Shortcut Learning in Deep Neural Networks
• A Review of Feature Selection Methods Based on Mutual Information
• Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans
• Deep Neural Networks and Tabular Data: A Survey
• Efficient Algorithms for t-distributed Stochastic Neighborhood Embedding
• Fifty Years of Pulsar Candidate Selection: From simple filters to a new principled real-time classification approach
• TabTransformer: Tabular Data Modeling Using Contextual Embeddings
• Revisiting Dimensionality Reduction Techniques for Visual Cluster Analysis: An Empirical Study
• SLISEMAP: Supervised dimensionality reduction through local explanations
• FDive: Learning Relevance Models using Pattern-based Similarity Measures
• Disentangling Dense Embeddings with Sparse Autoencoders

Cited by in corpus (2)

• Post-Hoc Feature Selection Layer for Neural Networks Interpretability
• A Feature Selection Layer Approach for Multi-Class Classification on Neural Networks