Supporting Analysis of Dimensionality Reduction Results with Contrastive Learning

Abstract

Dimensionality reduction (DR) is frequently used for analyzing and visualizing high-dimensional data as it provides a good first glance of the data. However, to interpret the DR result for gaining useful insights from the data, it would take additional analysis effort such as identifying clusters and understanding their characteristics. While there are many automatic methods (e.g., density-based clustering methods) to identify clusters, effective methods for understanding a cluster's characteristics are still lacking. A cluster can be mostly characterized by its distribution of feature values. Reviewing the original feature values is not a straightforward task when the number of features is large. To address this challenge, we present a visual analytics method that effectively highlights the essential features of a cluster in a DR result. To extract the essential features, we introduce an enhanced usage of contrastive principal component analysis (cPCA). Our method, called ccPCA (contrasting clusters in PCA), can calculate each feature's relative contribution to the contrast between one cluster and other clusters. With ccPCA, we have created an interactive system including a scalable visualization of clusters' feature contributions. We demonstrate the effectiveness of our method and system with case studies using several publicly available datasets.

This is the author's version of the article that has been published in IEEE Transactions on Visualization and Computer Graphics. The final version of this record is available at: 10.1109/TVCG.2019.2934251

References in corpus (8)

• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• Modern hierarchical, agglomerative clustering algorithms
• Visualizing Large-scale and High-dimensional Data
• An Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data
• Contrastive Variational Autoencoder Enhances Salient Features
• Clustrophile: A Tool for Visual Clustering Analysis
• Contrastive Principal Component Analysis
• Rich Component Analysis

Cited by in corpus (14)

• The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
• t-viSNE: Interactive Assessment and Interpretation of t-SNE Projections
• Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles
• Interactive Dimensionality Reduction for Comparative Analysis
• Uniform Manifold Approximation with Two-phase Optimization
• A Visual Analytics Approach for Hardware System Monitoring with Streaming Functional Data Analysis
• HUMAP: Hierarchical Uniform Manifold Approximation and Projection
• A Visual Analytics System for Multi-model Comparison on Clinical Data Predictions
• Adversarial Attacks on Machine Learning-Aided Visualizations
• Feature Clock: High-Dimensional Effects in Two-Dimensional Plots
• A Visual Analytics Framework for Contrastive Network Analysis
• A Visual Analytics Framework for Reviewing Multivariate Time-Series Data with Dimensionality Reduction
• A Visual Analytics System for Water Distribution System Optimization
• Exploring Multi-dimensional Data via Subset Embedding