An Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data

Abstract

Dimensionality reduction (DR) methods are commonly used for analyzing and visualizing multidimensional data. However, when data is a live streaming feed, conventional DR methods cannot be directly used because of their computational complexity and inability to preserve the projected data positions at previous time points. In addition, the problem becomes even more challenging when the dynamic data records have a varying number of dimensions as often found in real-world applications. This paper presents an incremental DR solution. We enhance an existing incremental PCA method in several ways to ensure its usability for visualizing streaming multidimensional data. First, we use geometric transformation and animation methods to help preserve a viewer's mental map when visualizing the incremental results. Second, to handle data dimension variants, we use an optimization method to estimate the projected data positions, and also convey the resulting uncertainty in the visualization. We demonstrate the effectiveness of our design with two case studies using real-world datasets.

arXiv commentThis is the author's version of the article that has been published in IEEE Transactions on Visualization and Computer Graphics. The final version of this record is available at: 10.1109/TVCG.2019.2934433

References in corpus (5)

• ADADELTA: An Adaptive Learning Rate Method
• An overview of gradient descent optimization algorithms
• Linear Dimensionality Reduction: Survey, Insights, and Generalizations
• Online Visual Analytics of Text Streams
• Progressive Data Science: Potential and Challenges

Cited by in corpus (14)

• The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
• A Survey on ML4VIS: Applying Machine Learning Advances to Data Visualization
• Supporting Analysis of Dimensionality Reduction Results with Contrastive Learning
• Interactive Dimensionality Reduction for Comparative Analysis
• A Visual Analytics Approach for Hardware System Monitoring with Streaming Functional Data Analysis
• HUMAP: Hierarchical Uniform Manifold Approximation and Projection
• Quantitative Evaluation of Time-Dependent Multidimensional Projection Techniques
• Xtreaming: an incremental multidimensional projection technique and its application to streaming data
• Adversarial Attacks on Machine Learning-Aided Visualizations
• A Visual Analytics Framework for Reviewing Multivariate Time-Series Data with Dimensionality Reduction
• A Visual Analytics Framework for Contrastive Network Analysis
• A Visual Analytics Framework for Reviewing Streaming Performance Data
• A Local Similarity-Preserving Framework for Nonlinear Dimensionality Reduction with Neural Networks
• Exploring Multi-dimensional Data via Subset Embedding