Structured SUMCOR Multiview Canonical Correlation Analysis for Large-Scale Data

Abstract

The sum-of-correlations (SUMCOR) formulation of generalized canonical correlation analysis (GCCA) seeks highly correlated low-dimensional representations of different views via maximizing pairwise latent similarity of the views. SUMCOR is considered arguably the most natural extension of classical two-view CCA to the multiview case, and thus has numerous applications in signal processing and data analytics. Recent work has proposed effective algorithms for handling the SUMCOR problem at very large scale. However, the existing scalable algorithms cannot incorporate structural regularization and prior information -- which are critical for good performance in real-world applications. In this work, we propose a new computational framework for large-scale SUMCOR GCCA that can easily incorporate a suite of structural regularizers which are frequently used in data analytics. The updates of the proposed algorithm are lightweight and the memory complexity is also low. In addition, the proposed algorithm can be readily implemented in a parallel fashion. We show that the proposed algorithm converges to a Karush-Kuhn-Tucker (KKT) point of the regularized SUMCOR problem. Judiciously designed simulations and real-data experiments are employed to demonstrate the effectiveness of the proposed algorithm.

References in corpus (8)

• Global Convergence of ADMM in Nonconvex Nonsmooth Optimization
• Penalty Dual Decomposition Method For Nonsmooth Nonconvex Optimization
• Finding Linear Structure in Large Datasets with Scalable Canonical Correlation Analysis
• Large scale canonical correlation analysis with iterative least squares
• A Randomized Algorithm for CCA
• A Comparison of Relaxations of Multiset Cannonical Correlation Analysis and Applications
• Doubly Accelerated Methods for Faster CCA and Generalized Eigendecomposition
• Identifying Outliers using Influence Function of Multiple Kernel Canonical Correlation Analysis

Cited by in corpus (5)

• Graph Multiview Canonical Correlation Analysis
• Generalized Canonical Correlation Analysis: A Subspace Intersection Approach
• Nonlinear Multiview Analysis: Identifiability and Neural Network-assisted Implementation
• Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration based Approach
• Communication-Efficient Federated Linear and Deep Generalized Canonical Correlation Analysis