Extracting the hierarchical organization of complex systems

Abstract

Extracting understanding from the growing ``sea'' of biological and socio-economic data is one of the most pressing scientific challenges facing us. Here, we introduce and validate an unsupervised method that is able to accurately extract the hierarchical organization of complex biological, social, and technological networks. We define an ensemble of hierarchically nested random graphs, which we use to validate the method. We then apply our method to real-world networks, including the air-transportation network, an electronic circuit, an email exchange network, and metabolic networks. We find that our method enables us to obtain an accurate multi-scale descriptions of a complex system.

Figures in screen resolution. Version with full resolution figures available at http://amaral.chem-eng.northwestern.edu/Publications/Papers/sales-pardo-2007.pdf

References in corpus (20)

• Modularity and community structure in networks
• The architecture of complex weighted networks
• Hierarchical organization of modularity in metabolic networks
• Functional cartography of complex metabolic networks
• Resolution limit in community detection
• Specificity and stability in topology of protein networks
• Comparing community structure identification
• The worldwide air transportation network: Anomalous centrality, community structure, and cities' global roles
• Self-similar community structure in organisations
• Modularity from Fluctuations in Random Graphs and Complex Networks
• Synchronization reveals topological scales in complex networks
• Detecting fuzzy community structures in complex networks with a Potts model
• Classes of complex networks defined by role-to-role connectivity profiles
• Module identification in bipartite and directed networks
• Limited resolution in complex network community detection with Potts model approach
• Structural Inference of Hierarchies in Networks
• Hierarchy Measures in Complex Networks
• Coarse-Graining and Self-Dissimilarity of Complex Networks
• An Information-Theoretic Approach to Network Modularity
• Post-Processing Hierarchical Community Structures: Quality Improvements and Multi-scale View

Cited by in corpus (132)

• Fast unfolding of communities in large networks
• Community detection in graphs
• Maps of random walks on complex networks reveal community structure
• Link Prediction in Complex Networks: A Survey
• Hierarchical structure and the prediction of missing links in networks
• Link communities reveal multiscale complexity in networks
• Detecting the overlapping and hierarchical community structure of complex networks
• Finding statistically significant communities in networks
• The performance of modularity maximization in practical contexts
• The map equation
• Consensus clustering in complex networks
• Missing and spurious interactions and the reconstruction of complex networks
• Kronecker Graphs: An Approach to Modeling Networks
• Detect overlapping and hierarchical community structure in networks
• Hierarchical modularity in human brain functional networks
• Analysis of the structure of complex networks at different resolution levels
• Multilevel compression of random walks on networks reveals hierarchical organization in large integrated systems
• A Poissonian explanation for heavy-tails in e-mail communication
• Random Walks, Markov Processes and the Multiscale Modular Organization of Complex Networks
• Laplacian Dynamics and Multiscale Modular Structure in Networks
• Uncovering space-independent communities in spatial networks
• Community landscapes: an integrative approach to determine overlapping network module hierarchy, identify key nodes and predict network dynamics
• Modularity-Maximizing Network Communities via Mathematical Programming
• Community Detection via Maximization of Modularity and Its Variants
• Hierarchical Block Structures and High-resolution Model Selection in Large Networks
• Multiresolution community detection for megascale networks by information-based replica correlations
• A sequential algorithm for fast clique percolation
• Systemic delay propagation in the US airport network
• Scalable detection of statistically significant communities and hierarchies, using message-passing for modularity
• Robust classification of salient links in complex networks
• The structure of borders in a small world
• Communities, Knowledge Creation, and Information Diffusion
• Evaluating Overfit and Underfit in Models of Network Community Structure
• Detection of gene communities in multi-networks reveals cancer drivers
• Think Locally, Act Locally: The Detection of Small, Medium-Sized, and Large Communities in Large Networks
• Fuzzy overlapping communities in networks
• Quantifying and identifying the overlapping community structure in networks
• Improved community structure detection using a modified fine tuning strategy
• Large-scale structure of a nation-wide production network
• Statistical significance of communities in networks
• The evolutionary origins of hierarchy
• Network structure of inter-industry flows
• Element-centric clustering comparison unifies overlaps and hierarchy
• Social significance of community structure: Statistical view
• The Scientific Prize Network Predicts Who Pushes the Boundaries of Science
• Spatial Guilds in the Serengeti Food Web Revealed by a Bayesian Group Model
• Multilayer stochastic block models reveal the multilayer structure of complex networks
• Systemic risk and spatiotemporal dynamics of the US housing market
• A network inference method for large-scale unsupervised identification of novel drug-drug interactions
• Reduced integration and improved segregation of functional brain networks in Alzheimer's disease
• A Survey of Heterogeneous Information Network Analysis
• Quantifying loopy network architectures
• Emergence of hierarchy in cost driven growth of spatial networks
• Origin of the Scaling Law in Human Mobility: Hierarchical Organization of Traffic Systems
• Mesoscopic organization reveals the constraints governing C. elegans nervous system
• Non-parametric Bayesian modeling of complex networks
• Median evidential c-means algorithm and its application to community detection
• Network Community Detection: A Review and Visual Survey
• Chaperones as integrators of cellular networks: Changes of cellular integrity in stress and diseases
• Finding multiple core-periphery pairs in networks
• Data-driven Computational Social Science: A Survey
• Core-periphery structure requires something else in the network
• Local dominance unveils clusters in networks
• Impact of community structure on information transfer
• Multi-scale Modularity in Complex Networks
• Practical Attacks Against Graph-based Clustering
• Predicting human preferences using the block structure of complex social networks
• Topological portraits of multiscale coordination dynamics
• Communities in Networks
• Correlation structure and principal components in global crude oil market
• Topological structures in the equities market network
• Network structure of subway passenger flows
• Detection of node group membership in networks with group overlap
• On the basic computational structure of gene regulatory networks
• Identifying communities by influence dynamics in social networks
• Adaptive Modularity Maximization via Edge Weighting Scheme
• Hierarchical Graph Clustering using Node Pair Sampling
• Super-resolution community detection for layer-aggregated multilayer networks
• Impact of hierarchical modular structure on ranking of individual nodes in directed networks
• Club Convergence of House Prices: Evidence from China's Ten Key Cities
• Hierarchical mutual information for the comparison of hierarchical community structures in complex networks
• Profiling of a network behind an infectious disease outbreak
• Data-driven modeling of systemic delay propagation under severe meteorological conditions
• Strong associations between microbe phenotypes and their network architecture
• Personality Traits and Ego-network Dynamics
• Using synchronism of chaos for adaptive learning of network topology
• Hyperlink communities in higher-order networks
• A unified data representation theory for network visualization, ordering and coarse-graining
• Planar unclustered scale-free graphs as models for technological and biological networks
• Measuring the Hierarchy of Feedforward Networks
• Identifying Overlapping and Hierarchical Thematic Structures in Networks of Scholarly Papers: A Comparison of Three Approaches
• Finding Community Structure Based on Subgraph Similarity
• Diffusion on hierarchical systems of weakly-coupled networks
• The Multiplex Efficiency Index: unveiling the Brazilian Air Transportation Multiplex Network -- BATMN
• Multiple phases in modularity-based community detection
• Scale-variant topological information for characterizing the structure of complex networks
• Resampling effects on significance analysis of network clustering and ranking
• Multiresolution Consensus Clustering in Networks
• Fragmenting networks by targeting collective influencers at a mesoscopic level
• Communities and classes in symmetric fractals
• Detecting the optimal number of communities in complex networks
• Transitions in spatial networks
• Learning Topological Representation for Networks via Hierarchical Sampling
• Reflective visualization and verbalization of unconscious preference
• Modular hierarchical and power-law small-world networks bear structural optima for minimal first passage times and cover time
• Nested partitions from hierarchical clustering statistical validation
• A hierarchy index for networks in the brain reveals a complex entangled organizational structure
• Communities in C.elegans connectome through the prism of non-backtracking walks
• Mining the modular structure of protein interaction networks
• Dynamics of interacting information waves in networks
• Criterions for locally dense subgraphs
• Self-falsifiable Hierarchical Detection of Overlapping Communities On Social Networks
• Local multiresolution order in community detection
• A Spectral Representation of Power Systems with Applications to Adaptive Grid Partitioning and Cascading Failure Localization
• Nonparametric Bayesian models of hierarchical structure in complex networks
• Vulnerable Connectivity Caused by Local Communities in Spatial Networks
• Detecting Statistically Significant Communities
• Towards a generalization of information theory for hierarchical partitions
• Comparison and Benchmark of Graph Clustering Algorithms
• Patterns of Ship-borne Species Spread: A Clustering Approach for Risk Assessment and Management of Non-indigenous Species Spread
• The Atlas for the Aspiring Network Scientist
• Fractals in the Nervous System: conceptual Implications for Theoretical Neuroscience
• A Flexible Iterative Framework for Consensus Clustering
• Multiscale Analysis and Optimisation of Photosynthetic Solar Energy Systems
• Finding community structure using the ordered random graph model
• Detecting Communities from Heterogeneous Graphs: A Context Path-based Graph Neural Network Model
• Multiscale Community Mining in Networks Using Spectral Graph Wavelets
• Multiplex Structures: Patterns of Complexity in Real-World Networks
• Application of a cognitive-inspired algorithm for detecting communities in mobility networks
• Characterization of delay propagation in the US air transportation network
• Characterizing Individual Communication Patterns
• A fast clustering algorithm for mining social network data