Connecting Network Science and Information Theory

Abstract

A framework integrating information theory and network science is proposed, giving rise to a potentially new area. By incorporating and integrating concepts such as complexity, coding, topological projections and network dynamics, the proposed network-based framework paves the way not only to extending traditional information science, but also to modeling, characterizing and analyzing a broad class of real-world problems, from language communication to DNA coding. Basically, an original network is supposed to be transmitted, with or without compaction, through a sequence of symbols or time-series obtained by sampling its topology by some network dynamics, such as random walks. We show that the degree of compression is ultimately related to the ability to predict the frequency of symbols based on the topology of the original network and the adopted dynamics. The potential of the proposed approach is illustrated with respect to the efficiency of transmitting several types of topologies by using a variety of random walks. Several interesting results are obtained, including the behavior of the Barabási-Albert model oscillating between high and low performance depending on the considered dynamics, and the distinct performances obtained for two geographical models.

References in corpus (14)

• Maps of random walks on complex networks reveal community structure
• Network structure of multivariate time series
• Causal Network Inference by Optimal Causation Entropy
• Entropy Rate of Diffusion Processes on Complex Networks
• Spectral entropies as information-theoretic tools for complex network comparison
• The dynamic of information-driven coordination phenomena: a transfer entropy analysis
• Using network science and text analytics to produce surveys in a scientific topic
• Probing the topological properties of complex networks modeling short written texts
• Knowledge Acquisition: A Complex Networks Approach
• Comparing the writing style of real and artificial papers
• Correlations between structure and dynamics in complex networks
• Unveiling the relationship between complex networks metrics and word senses
• Multiplex decomposition of non-Markovian dynamics and the hidden layer reconstruction problem
• Knitted Complex Networks

Cited by in corpus (5)

• A comparative analysis of knowledge acquisition performance in complex networks
• The Dynamics of Knowledge Acquisition via Self-Learning in Complex Networks
• Semantic flow in language networks
• Complex systems: features, similarity and connectivity
• Modeling the Perspectives for Scientific Advancement