Finding mixed memberships in categorical data
arXiv:2312.01565 · doi:10.1016/j.ins.2024.120785
Abstract
Latent class analysis, a fundamental problem in categorical data analysis, often encounters overlapping latent classes that introduce further challenges. This paper presents a solution to this problem by focusing on finding latent mixed memberships of subjects in categorical data with polytomous responses. We employ the Grade of Membership (GoM) model, which assigns each subject a membership score in each latent class. To address this, we propose two efficient spectral algorithms for estimating these mixed memberships and other GoM parameters. Our algorithms are based on the singular value decomposition of a regularized Laplacian matrix. We establish their convergence rates under a mild condition on data sparsity. Additionally, we introduce a metric to evaluate the quality of estimated mixed memberships for real-world categorical data and determine the optimal number of latent classes based on this metric. Finally, we demonstrate the practicality of our methods through experiments on both computer-generated and real-world categorical datasets.
References in corpus (13)
- Finding and evaluating community structure in networks
- Modularity and community structure in networks
- Assortative mixing in networks
- Mixing patterns in networks
- Fuzzy communities and the concept of bridgeness in complex networks
- Describing disability through individual-level mixture models for multivariate binary data
- Spectral Methods for Data Science: A Statistical Perspective
- Semidefinite Programming Based Preconditioning for More Robust Near-Separable Nonnegative Matrix Factorization
- A Tensor-EM Method for Large-Scale Latent Class Analysis with Binary Responses
- Dimension-Grouped Mixed Membership Models for Multivariate Categorical Data
- Randomized spectral co-clustering for large-scale directed networks
- Beyond the EM Algorithm: Constrained Optimization Methods for Latent Class Model
- A Spectral Method for Identifiable Grade of Membership Analysis with Binary Responses