Towards a Synergy-based Approach to Measuring Information Modification

Abstract

Distributed computation in artificial life and complex systems is often described in terms of component operations on information: information storage, transfer and modification. Information modification remains poorly described however, with the popularly-understood examples of glider and particle collisions in cellular automata being only quantitatively identified to date using a heuristic (separable information) rather than a proper information-theoretic measure. We outline how a recently-introduced axiomatic framework for measuring information redundancy and synergy, called partial information decomposition, can be applied to a perspective of distributed computation in order to quantify component operations on information. Using this framework, we propose a new measure of information modification that captures the intuitive understanding of information modification events as those involving interactions between two or more information sources. We also consider how the local dynamics of information modification in space and time could be measured, and suggest a new axiom that redundancy measures would need to meet in order to make such local measurements. Finally, we evaluate the potential for existing redundancy measures to meet this localizability axiom.

9 pages, 4 figures

References in corpus (3)

• Local information transfer as a spatiotemporal filter for complex systems
• Differentiating information transfer and causal effect
• Complexity Measures from Interaction Structures

Cited by in corpus (18)

• Measuring multivariate redundant information with pointwise common change in surprisal
• Efficient transfer entropy analysis of non-stationary neural time series
• Synergy and redundancy in the Granger causal analysis of dynamical networks
• Intersection Information based on Common Randomness
• Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
• Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
• A framework for the local information dynamics of distributed computation in complex systems
• Redundancy and synergy in dual decompositions of mutual information gain and information loss
• Quantifying synergistic information using intermediate stochastic variables
• Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI
• Quantifying Redundant Information in Predicting a Target Random Variable
• Information flow through a model of the C. elegans klinotaxis circuit
• Generalised Measures of Multivariate Information Content
• Local Causal States and Discrete Coherent Structures
• Orders between channels and implications for partial information decomposition
• A Measure of Synergy based on Union Information
• MAXENT3D_PID: An Estimator for the Maximum-entropy Trivariate Partial Information Decomposition
• Explicit Formula for Partial Information Decomposition