Nonparametric Canonical Correlation Analysis

Abstract

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep neural network methods. These approaches seek maximally correlated projections among families of functions, which the user specifies (by choosing a kernel or neural network structure), and are computationally demanding. Interestingly, the theory of nonlinear CCA, without functional restrictions, had been studied in the population setting by Lancaster already in the 1950s, but these results have not inspired practical algorithms. We revisit Lancaster's theory to devise a practical algorithm for nonparametric CCA (NCCA). Specifically, we show that the solution can be expressed in terms of the singular value decomposition of a certain operator associated with the joint density of the views. Thus, by estimating the population density from data, NCCA reduces to solving an eigenvalue system, superficially like kernel CCA but, importantly, without requiring the inversion of any kernel matrix. We also derive a partially linear CCA (PLCCA) variant in which one of the views undergoes a linear projection while the other is nonparametric. Using a kernel density estimate based on a small number of nearest neighbors, our NCCA and PLCCA algorithms are memory-efficient, often run much faster, and perform better than kernel CCA and comparable to deep CCA.

References in corpus (2)

• A kernel method for canonical correlation analysis
• Sparse Additive Functional and Kernel CCA

Cited by in corpus (20)

• On Universal Features for High-Dimensional Learning and Inference
• Kernel-based Sensor Fusion with Application to Audio-Visual Voice Activity Detection
• Conditional canonical correlation estimation based on covariates with random forests
• Local Canonical Correlation Analysis for Nonlinear Common Variables Discovery
• Spectral Discovery of Jointly Smooth Features for Multimodal Data
• Efficient Algorithms for Large-scale Generalized Eigenvector Computation and Canonical Correlation Analysis
• Latent common manifold learning with alternating diffusion: analysis and applications
• The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICA
• Task-Driven Common Representation Learning via Bridge Neural Network
• Kernel-based parameter estimation of dynamical systems with unknown observation functions
• Recovering Hidden Components in Multimodal Data with Composite Diffusion Operators
• Diffusion-based nonlinear filtering for multimodal data fusion with application to sleep stage assessment
• ORCCA: Optimal Randomized Canonical Correlation Analysis
• ${\ell }_0$-based Sparse Canonical Correlation Analysis
• A Latent Variable Model for Two-Dimensional Canonical Correlation Analysis and its Variational Inference
• Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration based Approach
• On the spectral property of kernel-based sensor fusion algorithms of high dimensional data
• Learning relevant features for statistical inference
• How do kernel-based sensor fusion algorithms behave under high dimensional noise?
• Tensor Canonical Correlation Analysis with Convergence and Statistical Guarantees