Successful network inference from time-series data using Mutual Information Rate

Abstract

This work uses an information-based methodology to infer the connectivity of complex systems from observed time-series data. We first derive analytically an expression for the Mutual Information Rate (MIR), namely, the amount of information exchanged per unit of time, that can be used to estimate the MIR between two finite-length low-resolution noisy time-series, and then apply it after a proper normalization for the identification of the connectivity structure of small networks of interacting dynamical systems. In particular, we show that our methodology successfully infers the connectivity for heterogeneous networks, different time-series lengths or coupling strengths, and even in the presence of additive noise. Finally, we show that our methodology based on MIR successfully infers the connectivity of networks composed of nodes with different time-scale dynamics, where inference based on Mutual Information fails.

References in corpus (15)

• Measuring Information Transfer
• Estimating Mutual Information
• The Lyapunov Characteristic Exponents and their computation
• Revealing Network Connectivity From Dynamics
• Inferring Network Topology from Complex Dynamics
• Revealing networks from dynamics: an introduction
• Maxwell's Refrigerator: An Exactly Solvable Model
• Coarse-grained entropy rates for characterization of complex time series
• The combined effect of chemical and electrical synapses in small Hindmarsch-Rose neural networks on synchronisation and on the rate of information
• Do Brain Networks Evolve by Maximizing their Information Flow Capacity?
• Mutual information rate and bounds for it
• Kolmogorov-Sinai entropy from recurrence times
• Optimal network topologies for information transmission in active networks
• Production and Transfer of Energy and Information in Hamiltonian Systems
• Energy transfer dynamics and thermalization of two oscillators interacting via chaos

Cited by in corpus (11)

• Model reconstruction from temporal data for coupled oscillator networks
• Entropy-based Generating Markov Partitions for Complex Systems
• Reconstructing dynamical networks via feature ranking
• An integrative dynamical perspective for graph theory and the study of complex networks
• Latent Variable Time-varying Network Inference
• Synergistic signatures of group mechanisms in higher-order systems
• Inference of forex and stock-index financial networks based on the normalised mutual information rate
• Inference of topology and the nature of synapses, and the flow of information in neuronal networks
• Network inference combining mutual information rate and statistical tests
• Impact of lag information on network inference
• Inferring, comparing and exploring ecological networks from time-series data through R packages constructnet, disgraph and dynet