Fast Super-Paramagnetic Clustering
arXiv:1810.02529 · doi:10.1016/j.physa.2019.124049
Abstract
We map stock market interactions to spin models to recover their hierarchical structure using a simulated annealing based Super-Paramagnetic Clustering (SPC) algorithm. This is directly compared to a modified implementation of a maximum likelihood approach we call Fast Super-Paramagnetic Clustering (f-SPC). The methods are first applied standard toy test-case problems, and then to a data-set of 447 stocks traded on the New York Stock Exchange (NYSE) over 1249 days. The signal to noise ratio of stock market correlation matrices is briefly considered. Our result recover approximately clusters representative of standard economic sectors and mixed ones whose dynamics shine light on the adaptive nature of financial markets and raise concerns relating to the effectiveness of industry based static financial market classification in the world of real-time data analytics. A key result is that we show that f-SPC maximum likelihood solutions converge to ones found within the Super-Paramagnetic Phase where the entropy is maximum, and those solutions are qualitatively better for high dimensionality data-sets.
arXiv comment25 pages, 41 Figures and code at https://github.com/tehraio/potts-model-clustering
References in corpus (18)
- Scikit-learn: Machine Learning in Python
- Emergence of scaling in random networks
- Fast unfolding of communities in large networks
- The performance of modularity maximization in practical contexts
- Bose-Einstein condensation in complex networks
- Spin-Glass Theory for Pedestrians
- The multivariate Tutte polynomial (alias Potts model) for graphs and matroids
- A model for correlations in stock markets
- Identification of clusters of companies in stock indices via Potts super-paramagnetic transitions
- An analysis of Cross-correlations in South African Market data
- Data clustering and noise undressing for correlation matrices
- Super-paramagnetic clustering of yeast gene expression profiles
- Algorithms of maximum likelihood data clustering with applications
- Successive normalization of rectangular arrays
- Detecting intraday financial market states using temporal clustering
- Hierarchical causality in financial economics
- Boltzmann machines and energy-based models
- High-speed detection of emergent market clustering via an unsupervised parallel genetic algorithm