A Tutorial on Principal Component Analysis

Abstract

Principal component analysis (PCA) is a mainstay of modern data analysis - a black box that is widely used but (sometimes) poorly understood. The goal of this paper is to dispel the magic behind this black box. This manuscript focuses on building a solid intuition for how and why principal component analysis works. This manuscript crystallizes this knowledge by deriving from simple intuitions, the mathematics behind PCA. This tutorial does not shy away from explaining the ideas informally, nor does it shy away from the mathematics. The hope is that by addressing both aspects, readers of all levels will be able to gain a better understanding of PCA as well as the when, the how and the why of applying this technique.

Cited by in corpus (20)

• Harnessing speckle for a sub-femtometre resolved broadband wavemeter and laser stabilization
• Weighted principal component analysis: a weighted covariance eigendecomposition approach
• Exploring the Space of Black-box Attacks on Deep Neural Networks
• Robust PCA for Anomaly Detection in Cyber Networks
• A Bayesian method for detecting stellar flares
• Simulated evolution of protein-protein interaction networks with realistic topology
• Autoencoder, Principal Component Analysis and Support Vector Regression for Data Imputation
• Simple and Effective Dimensionality Reduction for Word Embeddings
• Using PCA to Efficiently Represent State Spaces
• Principal component analysis within nuclear structure
• Microstructure under the Microscope: Tools to Survive and Thrive in The Age of (Too Much) Information
• Comparison of Data Imputation Techniques and their Impact
• Learning phase transitions: comparing PCA and SVM
• Dynamic Principal Component Analysis: Identifying the Relationship between Multiple Air Pollutants
• Redshift determination through weighted phase correlation: a linearithmic implementation
• DigiVoice: Voice Biomarker Featurization and Analysis Pipeline
• Opening the low-background and high-spectral-resolution domain with the ATHENA large X-ray observatory: Development of the Cryogenic AntiCoincidence Detector for the X-ray Integral Field Unit
• ToF-SIMS Investigations on Dental Implant Materials and Adsorbed Protein Films
• Homogenization of Metamaterials by Dual Interpolation of Fields: a Rigorous Treatment of Resonances and Nonlocality
• An octree cells occupancy geometric dimensionality descriptor for massive on-server point cloud visualisation and classification