Kullback-Leibler distance as a measure of the information filtered from multivariate data

Abstract

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically determine the expected values of the Kullback-Leibler distance of a sample correlation matrix from a reference model and we show that the expected values are known also when the specific model is unknown. We propose to make use of the Kullback-Leibler distance to estimate the information extracted from a correlation matrix by correlation filtering procedures. We also show how to use this distance to measure the stability of filtering procedures with respect to statistical uncertainty. We explain the effectiveness of our method by comparing four filtering procedures, two of them being based on spectral analysis and the other two on hierarchical clustering. We compare these techniques as applied both to simulations of factor models and empirical data. We investigate the ability of these filtering procedures in recovering the correlation matrix of models from simulations. We discuss such an ability in terms of both the heterogeneity of model parameters and the length of data series. We also show that the two spectral techniques are typically more informative about the sample correlation matrix than techniques based on hierarchical clustering, whereas the latter are more stable with respect to statistical uncertainty.

arXiv comment13 pages, 6 figures

References in corpus (7)

• Hierarchical Structure in Financial Markets
• Noise Dressing of Financial Correlation Matrices
• Universal and non-universal properties of cross-correlations in financial time series
• Dynamic modeling of gene expression data
• Effective matter superpotentials from Wishart random matrices
• Hierarchically nested factor model from multivariate data
• Portfolio Optimization and the Random Magnet Problem

Cited by in corpus (19)

• Correlation, hierarchies, and networks in financial markets
• Correlation of financial markets in times of crisis
• Cleaning large correlation matrices: tools from random matrix theory
• Community detection for correlation matrices
• Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods
• Entropies of complex networks with hierarchically constrained topologies
• Carbon-dioxide emissions trading and hierarchical structure in worldwide finance and commodities markets
• Uncovering the Dynamics of Correlation Structures Relative to the Collective Market Motion
• A New Attempt to Identify Long-term Precursors for Endogenous Financial Crises in the Market Correlation Structures
• Clustering Financial Time Series: How Long is Enough?
• Hausdorff clustering
• Building portfolios of stocks in the São Paulo Stock Exchange using Random Matrix Theory
• Two-step estimators of high dimensional correlation matrices
• Accounting for risk of non linear portfolios: a novel Fourier approach
• Random matrix theory and nested clustered portfolios on Mexican markets
• Quantifying the information lost in optimal covariance matrix cleaning
• Kullback-Leibler cluster entropy to quantify volatility correlation and risk diversity
• High-dimensional covariance matrix estimators on simulated portfolios with complex structures
• Reactive Global Minimum Variance Portfolios with $k-$BAHC covariance cleaning