Parsimonious modeling with Information Filtering Networks

Abstract

We introduce a methodology to construct parsimonious probabilistic models. This method makes use of Information Filtering Networks to produce a robust estimate of the global sparse inverse covariance from a simple sum of local inverse covariances computed on small sub-parts of the network. Being based on local and low-dimensional inversions, this method is computationally very efficient and statistically robust even for the estimation of inverse covariance of high-dimensional, noisy and short time-series. Applied to financial data our method results computationally more efficient than state-of-the-art methodologies such as Glasso producing, in a fraction of the computation time, models that can have equivalent or better performances but with a sparser inference structure. We also discuss performances with sparse factor models where we notice that relative performances decrease with the number of factors. The local nature of this approach allows us to perform computations in parallel and provides a tool for dynamical adaptation by partial updating when the properties of some variables change without the need of recomputing the whole model. This makes this approach particularly suitable to handle big datasets with large numbers of variables. Examples of practical application for forecasting, stress testing and risk allocation in financial systems are also provided.

arXiv comment17 pages, 10 figures, 3 tables

References in corpus (10)

• MCMC using Hamiltonian dynamics
• High-dimensional graphs and variable selection with the Lasso
• Hierarchical Structure in Financial Markets
• Weak pairwise correlations imply strongly correlated network states in a neural population
• Granger causality and transfer entropy are equivalent for Gaussian variables
• A tool for filtering information in complex systems
• Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (2001)
• Perturbation Biology: inferring signaling networks in cellular systems
• Hierarchical information clustering by means of topologically embedded graphs
• Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods

Cited by in corpus (10)

• Synchronization in Network Geometries with Finite Spectral Dimension
• FTX's downfall and Binance's consolidation: The fragility of centralised digital finance
• Forecasting market states
• Dependency structures in cryptocurrency market from high to low frequency
• Market structure dynamics during COVID-19 outbreak
• Learning Clique Forests
• A memory-based method to select the number of relevant components in Principal Component Analysis
• Structural importance and evolution: an application to financial transaction networks
• Simplicial persistence of financial markets: filtering, generative processes and portfolio risk
• An Information Filtering approach to stress testing: an application to FTSE markets