A framework for the local information dynamics of distributed computation in complex systems
arXiv:0811.2690 · doi:10.1007/978-3-642-53734-9_5
Abstract
The nature of distributed computation has often been described in terms of the component operations of universal computation: information storage, transfer and modification. We review the first complete framework that quantifies each of these individual information dynamics on a local scale within a system, and describes the manner in which they interact to create non-trivial computation where "the whole is greater than the sum of the parts". We describe the application of the framework to cellular automata, a simple yet powerful model of distributed computation. This is an important application, because the framework is the first to provide quantitative evidence for several important conjectures about distributed computation in cellular automata: that blinkers embody information storage, particles are information transfer agents, and particle collisions are information modification events. The framework is also shown to contrast the computations conducted by several well-known cellular automata, highlighting the importance of information coherence in complex computation. The results reviewed here provide important quantitative insights into the fundamental nature of distributed computation and the dynamics of complex systems, as well as impetus for the framework to be applied to the analysis and design of other systems.
44 pages, 8 figures
References in corpus (9)
- Optimal Dynamical Range of Excitable Networks at Criticality
- JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
- Local information transfer as a spatiotemporal filter for complex systems
- Nonnegative Decomposition of Multivariate Information
- Differentiating information transfer and causal effect
- The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing
- Towards a Synergy-based Approach to Measuring Information Modification
- Synchronization in the presence of memory
- On active information storage in input-driven systems
Cited by in corpus (11)
- JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
- Differentiating information transfer and causal effect
- Measuring multivariate redundant information with pointwise common change in surprisal
- Bits from Biology for Computational Intelligence
- IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks
- Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes
- Towards information based spatiotemporal patterns as a foundation for agent representation in dynamical systems
- Neuroevolution on the Edge of Chaos
- A partial information decomposition for discrete and continuous variables
- "Infographics" team: Selecting Control Parameters via Maximal Fisher Information
- RoboCup 2D Soccer Simulation League: Evaluation Challenges