Local information transfer as a spatiotemporal filter for complex systems

Abstract

We present a measure of local information transfer, derived from an existing averaged information-theoretical measure, namely transfer entropy. Local transfer entropy is used to produce profiles of the information transfer into each spatiotemporal point in a complex system. These spatiotemporal profiles are useful not only as an analytical tool, but also allow explicit investigation of different parameter settings and forms of the transfer entropy metric itself. As an example, local transfer entropy is applied to cellular automata, where it is demonstrated to be a novel method of filtering for coherent structure. More importantly, local transfer entropy provides the first quantitative evidence for the long-held conjecture that the emergent traveling coherent structures known as particles (both gliders and domain walls, which have analogues in many physical processes) are the dominant information transfer agents in cellular automata.

12 pages

References in corpus (5)

• Measuring Information Transfer
• Quantifying Self-Organization with Optimal Predictors
• Automatic Filters for the Detection of Coherent Structure in Spatiotemporal Systems
• Upper Bound on the Products of Particle Interactions in Cellular Automata
• From Finite to Infinite Range Order via Annealing: The Causal Architecture of Deformation Faulting in Annealed Close-Packed Crystals

Cited by in corpus (47)

• Colloquium: Criticality and dynamical scaling in living systems
• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Differentiating information transfer and causal effect
• Dynamic information routing in complex networks
• Semantic information, autonomous agency, and nonequilibrium statistical physics
• Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
• Information Flows? A Critique of Transfer Entropies
• Efficient transfer entropy analysis of non-stationary neural time series
• Structure and causality relations in a global network of financial companies
• Bits from Biology for Computational Intelligence
• Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing
• Multivariate Dependence Beyond Shannon Information
• Decomposing causality into its synergistic, unique, and redundant components
• Transfer entropy in continuous time, with applications to jump and neural spiking processes
• A mathematical perspective on edge-centric brain functional connectivity
• A framework for the local information dynamics of distributed computation in complex systems
• Introducing a differentiable measure of pointwise shared information
• Towards a Synergy-based Approach to Measuring Information Modification
• Self-referential basis of undecidable dynamics: from The Liar Paradox and The Halting Problem to The Edge of Chaos
• Using mutual information to measure order in model glass-formers
• Information flow through a model of the C. elegans klinotaxis circuit
• Information Processing by Networks of Quantum Decision Makers
• Quantifying high-order interdependencies on individual patterns via the local O-information: theory and applications to music analysis
• Deriving pairwise transfer entropy from network structure and motifs
• Characterising information-theoretic storage and transfer in continuous time processes
• Local Causal States and Discrete Coherent Structures
• Measuring information transfer in a soft robotic arm
• Local Granger Causality
• Discovering Nonlinear Relations with Minimum Predictive Information Regularization
• Precursor-driven machine learning prediction of chaotic extreme pulses in Kerr resonators
• An Information Criterion for Inferring Coupling in Distributed Dynamical Systems
• Neuroevolution on the Edge of Chaos
• Swarm Analytics: Designing Information Markers to Characterise Swarm Systems in Shepherding Contexts
• Information Transfer in Swarms with Leaders
• Why and How do Complex Systems Self-Organize at All? Average Action Efficiency as a Predictor, Measure, Driver, and Mechanism of Self-Organization
• Direct and Indirect Effects -- An Information Theoretic Perspective
• Entropy balance and Information processing in bipartite and non-bipartite composite systems
• Balanced Information Storage and Transfer in Modular Spiking Neural Networks
• Consensus between Epistemic Agents is Difficult
• Relating complexities for the reflexive study of complex systems
• Intelligence, physics and information -- the tradeoff between accuracy and simplicity in machine learning
• Learning interaction rules from multi-animal trajectories via augmented behavioral models
• "Infographics" team: Selecting Control Parameters via Maximal Fisher Information
• What drives bitcoin? An approach from continuous local transfer entropy and deep learning classification models
• Plant-wide fault and disturbance screening using combined transfer entropy and eigenvector centrality analysis
• Disentangling causal webs in the brain using functional Magnetic Resonance Imaging: A review of current approaches
• On the Heisenberg principle at macroscopic scales: understanding classical negative information. Towards a general physical theory of information