Group Component Analysis for Multiblock Data: Common and Individual Feature Extraction

Abstract

Very often data we encounter in practice is a collection of matrices rather than a single matrix. These multi-block data are naturally linked and hence often share some common features and at the same time they have their own individual features, due to the background in which they are measured and collected. In this study we proposed a new scheme of common and individual feature analysis (CIFA) that processes multi-block data in a linked way aiming at discovering and separating their common and individual features. According to whether the number of common features is given or not, two efficient algorithms were proposed to extract the common basis which is shared by all data. Then feature extraction is performed on the common and the individual spaces separately by incorporating the techniques such as dimensionality reduction and blind source separation. We also discussed how the proposed CIFA can significantly improve the performance of classification and clustering tasks by exploiting common and individual features of samples respectively. Our experimental results show some encouraging features of the proposed methods in comparison to the state-of-the-art methods on synthetic and real data.

13 pages,11 figures

References in corpus (2)

• Frequency Recognition in SSVEP-based BCI using Multiset Canonical Correlation Analysis
• Linked Component Analysis from Matrices to High Order Tensors: Applications to Biomedical Data

Cited by in corpus (20)

• Linked Component Analysis from Matrices to High Order Tensors: Applications to Biomedical Data
• Integrative Factorization of Bidimensionally Linked Matrices
• Multisubject Task-Related fMRI Data Processing via a Two-Stage Generalized Canonical Correlation Analysis
• Joint, Partially-joint, and Individual Independent Component Analysis in Multi-Subject fMRI Data
• D-GCCA: Decomposition-based Generalized Canonical Correlation Analysis for Multi-view High-dimensional Data
• Bayesian time-aligned factor analysis of paired multivariate time series
• Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis
• Non-iterative Joint and Individual Variation Explained
• Tensor Valued Common and Individual Feature Extraction: Multi-dimensional Perspective
• Comparative study of Discrete Wavelet Transforms and Wavelet Tensor Train decomposition to feature extraction of FTIR data of medicinal plants
• Generalized Integrative Principal Component Analysis for Multi-Type Data with Block-Wise Missing Structure
• Sparse outlier-robust PCA for multi-source data
• CDPA: Common and Distinctive Pattern Analysis between High-dimensional Datasets
• The sum of tensor networks
• Probabilistic Joint and Individual Variation Explained (ProJIVE) for Data Integration
• Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier
• Multi-tensor Completion for Estimating Missing Values in Video Data
• Model Inconsistent but Correlated Noise: Multi-view Subspace Learning with Regularized Mixture of Gaussians
• Modelling hidden structure of signals in group data analysis with modified (Lr, 1) and block-term decompositions
• Angle-Based Joint and Individual Variation Explained