Balanced Information Storage and Transfer in Modular Spiking Neural Networks
arXiv:1708.04392
Abstract
While information processing in complex systems can be described in abstract, general terms, there are cases in which the relation between these computations and the physical substrate of the underlying system is itself of interest. Prominently, the brain is one such case. With the aim of relating information and dynamics in biological neural systems, we study a model network of spiking neurons with different coupling configurations, and explore the relation between its informational, dynamical, and topological properties. We find that information transfer and storage peak at two separate points for different values of the coupling parameter, and are balanced at an intermediate point. In this configuration, avalanches in the network follow a long-tailed, power law-like distribution. Furthermore, the avalanche statistics at this point reproduce empirical findings in the biological brain.
References in corpus (10)
- Measuring Information Transfer
- Estimating Mutual Information
- Granger causality and transfer entropy are equivalent for Gaussian variables
- Powerlaw: a Python package for analysis of heavy-tailed distributions
- JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
- Local information transfer as a spatiotemporal filter for complex systems
- Differentiating information transfer and causal effect
- Learning as a phenomenon occurring in a critical state
- Transfer Entropy as a Log-likelihood Ratio
- Integrated Information and Metastability in Systems of Coupled Oscillators