A faster horse on a safer trail: generalized inference for the efficient reconstruction of weighted networks

Abstract

Due to the interconnectedness of financial entities, estimating certain key properties of a complex financial system (e.g. the implied level of systemic risk) requires detailed information about the structure of the underlying network. However, since data about financial linkages are typically subject to confidentiality, network reconstruction techniques become necessary to infer both the presence of connections and their intensity. Recently, several "horse races" have been conducted to compare the performance of the available financial network reconstruction methods. These comparisons, however, were based on arbitrarily-chosen similarity metrics between the real and the reconstructed network. Here we establish a generalised maximum-likelihood approach to rigorously define and compare weighted reconstruction methods. Our generalization maximizes the conditional entropy to solve the problem represented by the fact that the density-dependent constraints required to reliably reconstruct the network are typically unobserved. The resulting approach admits as input any reconstruction method for the purely binary topology and, conditionally on the latter, exploits the available partial information to infer link weights. We find that the most reliable method is obtained by "dressing" the best-performing binary method with an exponential distribution of link weights having a properly density-corrected and link-specific mean value and propose two unbiased (in the sense of maximum conditional entropy) variants of it. While the one named CReMA is perfectly general (as a particular case, it can place optimal weights on a network whose topology is known), the one named CReMB is recommended both in case of full uncertainty about the network topology and if the existence of some links is certain. In these cases, the CReMB is faster and reproduces empirical networks with highest generalised likelihood.

arXiv comment19 pages, 4 figures, 1 table

References in corpus (13)

• The Statistical Physics of Real-World Networks
• Analytical maximum-likelihood method to detect patterns in real networks
• Maximum likelihood: extracting unbiased information from complex networks
• Early-warning signals of topological collapse in interbank networks
• Systemic risk analysis in reconstructed economic and financial networks
• Randomizing world trade. II. A weighted network analysis
• Enhanced reconstruction of weighted networks from strengths and degrees
• Reconstruction methods for networks: the case of economic and financial systems
• Unbiased sampling of network ensembles
• Estimating topological properties of weighted networks from limited information
• The Grand Canonical ensemble of weighted networks
• Network reconstruction via density sampling
• Systemic Risk, Maximum Entropy and Interbank Contagion

Cited by in corpus (18)

• The Physics of Financial Networks
• Fast and scalable likelihood maximization for Exponential Random Graph Models with local constraints
• Reconstructing networks
• Reconstructing firm-level interactions: the Dutch input-output network
• The Weighted Bitcoin Lightning Network
• Bow-Tie Structures of Twitter Discursive Communities
• Fluctuating ecological networks: a synthesis of maximum-entropy approaches for pattern detection and process inference
• Entropy-based models to randomize real-world hypergraphs
• Inferring comparative advantage via entropy maximization
• Reconstructing supply networks
• Patterns of link reciprocity in directed, signed networks
• Reconciling econometrics with continuous maximum-entropy network models
• Critical density for network reconstruction
• Gravity models of networks: integrating maximum-entropy and econometric approaches
• Deterministic, quenched and annealed parameter estimation for heterogeneous network models
• Interbank network reconstruction enforcing density and reciprocity
• Multilayer Network Analysis of European Regional Flows
• Commodity-specific triads in the Dutch inter-industry production network