A Tutorial on Principal Component Analysis

Abstract

Principal component analysis (PCA) is a mainstay of modern data analysis - a black box that is widely used but (sometimes) poorly understood. The goal of this paper is to dispel the magic behind this black box. This manuscript focuses on building a solid intuition for how and why principal component analysis works. This manuscript crystallizes this knowledge by deriving from simple intuitions, the mathematics behind PCA. This tutorial does not shy away from explaining the ideas informally, nor does it shy away from the mathematics. The hope is that by addressing both aspects, readers of all levels will be able to gain a better understanding of PCA as well as the when, the how and the why of applying this technique.

Cited by in corpus (57)

• Machine Learning in Aerodynamic Shape Optimization
• Harnessing speckle for a sub-femtometre resolved broadband wavemeter and laser stabilization
• IoT Data Analytics in Dynamic Environments: From An Automated Machine Learning Perspective
• Weighted principal component analysis: a weighted covariance eigendecomposition approach
• Exploring the Space of Black-box Attacks on Deep Neural Networks
• Reducing the complexity of chemical networks via interpretable autoencoders
• Robust PCA for Anomaly Detection in Cyber Networks
• Black-box Safety Analysis and Retraining of DNNs based on Feature Extraction and Clustering
• Galaxy classification: deep learning on the OTELO and COSMOS databases
• A Bayesian method for detecting stellar flares
• Simulated evolution of protein-protein interaction networks with realistic topology
• Exploratory Data Analysis for Airline Disruption Management
• Astronomaly at scale: searching for anomalies amongst 4 million galaxies
• Unsupervised classification of simulated magnetospheric regions
• Autoencoder, Principal Component Analysis and Support Vector Regression for Data Imputation
• Simple and Effective Dimensionality Reduction for Word Embeddings
• Parameter Estimation with Maximal Updated Densities
• Using PCA to Efficiently Represent State Spaces
• Dev2vec: Representing Domain Expertise of Developers in an Embedding Space
• Principal component analysis within nuclear structure
• Gradient and Uncertainty Enhanced Sequential Sampling for Global Fit
• Microstructure under the Microscope: Tools to Survive and Thrive in The Age of (Too Much) Information
• High-precision programming of large-scale ring resonator circuits with minimal pre-calibration
• Comparison of Data Imputation Techniques and their Impact
• Clustering in Recurrent Neural Networks for Micro-Segmentation using Spending Personality
• Towards Exploratory Landscape Analysis for Large-scale Optimization: A Dimensionality Reduction Framework
• Phishing Detection through Email Embeddings
• Learning phase transitions: comparing PCA and SVM
• Comparing directed networks via denoising graphlet distributions
• BSpell: A CNN-Blended BERT Based Bangla Spell Checker
• Ambitions for theory in the physics of life
• DigiVoice: Voice Biomarker Featurization and Analysis Pipeline
• Redshift determination through weighted phase correlation: a linearithmic implementation
• TESDA: Transform Enabled Statistical Detection of Attacks in Deep Neural Networks
• Dynamic Principal Component Analysis: Identifying the Relationship between Multiple Air Pollutants
• Datasets of the solar quiet (Sq) and solar disturbed (SD) variations of the geomagnetic field from the mid latitudinal Magnetic Observatory of Coimbra (Portugal) obtained by different methods
• A Survey of Techniques All Classifiers Can Learn from Deep Networks: Models, Optimizations, and Regularization
• Opening the low-background and high-spectral-resolution domain with the ATHENA large X-ray observatory: Development of the Cryogenic AntiCoincidence Detector for the X-ray Integral Field Unit
• Localized Compression: Applying Convolutional Neural Networks to Compressed Images
• Optimization of Wireless Sensor Network Deployment for Spatiotemporal Reconstruction and Prediction
• Out-Of-Distribution Detection With Subspace Techniques And Probabilistic Modeling Of Features
• Beam Profiling with Noise Reduction From Computer Vision and Principal Component Analysis for the MAGIS-100 Experiment
• ToF-SIMS Investigations on Dental Implant Materials and Adsorbed Protein Films
• Liquid Sensing Using WiFi Signals
• Vis-SPLIT: Interactive Hierarchical Modeling for mRNA Expression Classification
• Interpretable Network Representation Learning with Principal Component Analysis
• Comparison of Clustering Methods for Extraction of Uncorrelated Sparse Sources from Data Mixtures
• An octree cells occupancy geometric dimensionality descriptor for massive on-server point cloud visualisation and classification
• Algorithms and Hardness for Linear Algebra on Geometric Graphs
• Unsupervised Spoken Term Discovery on Untranscribed Speech
• Learning Low-dimensional Manifolds for Scoring of Tissue Microarray Images
• TransAug: Translate as Augmentation for Sentence Embeddings
• Towards real time assessment of intramuscular fat content in meat using optical fibre-based optical coherence tomography
• Homogenization of Metamaterials by Dual Interpolation of Fields: a Rigorous Treatment of Resonances and Nonlocality
• Multi-Fusion Chinese WordNet (MCW) : Compound of Machine Learning and Manual Correction
• RPM-Net: Robust Pixel-Level Matching Networks for Self-Supervised Video Object Segmentation
• Quantum algorithm for the classification of Supersymmetric top quark events