Rethinking PCA Through Duality

Jan Quan, Johan Suykens, Panagiotis Patrinos

Motivated by the recently shown connection between self-attention and (kernel) principal component analysis (PCA), we revisit the fundamentals of PCA. Using the difference-of-conve…