Mutual information rate and bounds for it

Abstract

The amount of information exchanged per unit of time between two nodes in a dynamical network or between two data sets is a powerful concept for analysing complex systems. This quantity, known as the mutual information rate (MIR), is calculated from the mutual information, which is rigorously defined only for random systems. Moreover, the definition of mutual information is based on probabilities of significant events. This work offers a simple alternative way to calculate the MIR in dynamical (deterministic) networks or between two data sets (not fully deterministic), and to calculate its upper and lower bounds without having to calculate probabilities, but rather in terms of well known and well defined quantities in dynamical systems. As possible applications of our bounds, we study the relationship between synchronisation and the exchange of information in a system of two coupled maps and in experimental networks of coupled oscillators.

References in corpus (4)

• Complex networks in climate dynamics - Comparing linear and nonlinear network construction methods
• Mutual information for the selection of relevant variables in spectrometric nonlinear modelling
• General Framework for phase synchronization through localized sets
• Transmission of Information in Active Networks

Cited by in corpus (11)

• Do Brain Networks Evolve by Maximizing their Information Flow Capacity?
• Successful network inference from time-series data using Mutual Information Rate
• Inference of forex and stock-index financial networks based on the normalised mutual information rate
• Global interactions, information flow, and chaos synchronization
• Production and Transfer of Energy and Information in Hamiltonian Systems
• Impact of large scale climate oscillation on drought in West Africa
• Network inference combining mutual information rate and statistical tests
• Information-Theoretic Limits for Steganography in Multimedia
• Chaotic, informational and synchronous behaviour of multiplex networks
• Chimera states in ring-star network of Chua circuits
• Markovian language model of the DNA and its information content