Random matrix approach to multivariate categorical data analysis
arXiv:1503.06559 · doi:10.1103/PhysRevE.92.032130
Abstract
Correlation and similarity measures are widely used in all the areas of sciences and social sciences. Often the variables are not numbers but are instead qualitative descriptors called categorical data. We define and study similarity matrix, as a measure of similarity, for the case of categorical data. This is of interest due to a deluge of categorical data, such as movie ratings, top-10 rankings and data from social media, in the public domain that require analysis. We show that the statistical properties of the spectra of similarity matrices, constructed from categorical data, follow those from random matrix theory. We demonstrate this approach by applying it to the data of Indian general elections and sea level pressures in North Atlantic ocean.
arXiv comment6 pages, 7 figures
References in corpus (10)
- Random Matrix Theories in Quantum Physics: Common Concepts
- Noise Dressing of Financial Correlation Matrices
- Universal and non-universal properties of cross-correlations in financial time series
- A Random Matrix Approach to Cross-Correlations in Financial Data
- Collective behavior of stock price movements in an emerging market
- Community detection for correlation matrices
- Statistics of Atmospheric Correlations
- Temporal correlations versus noise in the correlation matrix formalism: an example of the brain auditory response
- Random Matrix approach to collective behavior and bulk universality in protein dynamics
- Spectral analysis of finite-time correlation matrices near equilibrium phase transitions