Revisiting Dimensionality Reduction Techniques for Visual Cluster Analysis: An Empirical Study

Abstract

Dimensionality Reduction (DR) techniques can generate 2D projections and enable visual exploration of cluster structures of high-dimensional datasets. However, different DR techniques would yield various patterns, which significantly affect the performance of visual cluster analysis tasks. We present the results of a user study that investigates the influence of different DR techniques on visual cluster analysis. Our study focuses on the most concerned property types, namely the linearity and locality, and evaluates twelve representative DR techniques that cover the concerned properties. Four controlled experiments were conducted to evaluate how the DR techniques facilitate the tasks of 1) cluster identification, 2) membership identification, 3) distance comparison, and 4) density comparison, respectively. We also evaluated users' subjective preference of the DR techniques regarding the quality of projected clusters. The results show that: 1) Non-linear and Local techniques are preferred in cluster identification and membership identification; 2) Linear techniques perform better than non-linear techniques in density comparison; 3) UMAP (Uniform Manifold Approximation and Projection) and t-SNE (t-Distributed Stochastic Neighbor Embedding) perform the best in cluster identification and membership identification; 4) NMF (Nonnegative Matrix Factorization) has competitive performance in distance comparison; 5) t-SNLE (t-Distributed Stochastic Neighbor Linear Embedding) has competitive performance in density comparison.

arXiv commentIEEE VIS 2021, to appear in IEEE Transactions on Visualization & Computer Graphics

References in corpus (5)

• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• t-viSNE: Interactive Assessment and Interpretation of t-SNE Projections
• An Analysis of the t-SNE Algorithm for Data Visualization
• sPortfolio: Stratified Visual Analysis of Stock Portfolios
• Quantitative Evaluation of Time-Dependent Multidimensional Projection Techniques

Cited by in corpus (11)

• Uniform Manifold Approximation with Two-phase Optimization
• Unveiling High-dimensional Backstage: A Survey for Reliable Visual Analytics with Dimensionality Reduction
• Large-Scale Evaluation of Topic Models and Dimensionality Reduction Methods for 2D Text Spatialization
• TBSSvis: Visual Analytics for Temporal Blind Source Separation
• A Critical Analysis of the Usage of Dimensionality Reduction in Four Domains
• Distortion-Aware Brushing for Reliable Cluster Analysis in Multidimensional Projections
• Investigating Privacy Leakage in Dimensionality Reduction Methods via Reconstruction Attack
• Data Type Agnostic Visual Sensitivity Analysis
• Dataset-Adaptive Dimensionality Reduction
• Uncertainty-Aware PCA for Arbitrarily Distributed Data Modeled by Gaussian Mixture Models
• A Feature Selection Layer Approach for Multi-Class Classification on Neural Networks