The behaviour of information flow near criticality

Abstract

Recent experiments have indicated that many biological systems self-organise near their critical point, which hints at a common design principle. While it has been suggested that information transmission is optimized near the critical point, it remains unclear how information transmission depends on the dynamics of the input signal, the distance over which the information needs to be transmitted, and the distance to the critical point. Here we employ stochastic simulations of a driven 2D Ising system and study the instantaneous mutual information and the information transmission rate between a driven input spin and an output spin. The instantaneous mutual information varies non-monotonically with the temperature, but increases monotonically with the correlation time of the input signal. In contrast, the information transmission rate exhibits a maximum as a function of the input correlation time. Moreover, there exists an optimal temperature that maximizes this maximum information transmission rate. It arises from a tradeoff between the necessity to respond fast to changes in the input so that more information per unit amount of time can be transmitted, and the need to respond to reliably. The optimal temperature lies above the critical point, but moves towards it as the distance between the input and output spin is increased.

arXiv comment16 pages, 13 figures

References in corpus (14)

• Measuring Information Transfer
• Scale-free correlations in bird flocks
• Are biological systems poised at criticality?
• Entropy and information in neural spike trains: Progress on the sampling problem
• Mutual information between in- and output trajectories of biochemical networks
• Information transmission in genetic regulatory networks: a review
• Mutual information in time-varying biochemical systems
• Optimal Prediction by Cellular Signaling Networks
• Universal role of correlation entropy in critical phenomena
• Synergy as a warning sign of transitions: the case of the two-dimensional Ising model
• What we learn from the learning rate
• Decomposing information into copying versus transformation
• A universal lower bound on the free energy cost of molecular measurements
• Theory for the optimal detection of time-varying signals in cellular sensing systems

Cited by in corpus (6)

• E. coli chemotaxis is information-limited
• Path Weight Sampling: Exact Monte Carlo Computation of the Mutual Information between Stochastic Trajectories
• Inferring couplings in networks across order-disorder phase transitions
• Duality between predictability and reconstructability in complex systems
• Multicellular sensing at a feedback-induced critical point
• Characterizing the non-monotonic behavior of mutual information along biochemical reaction cascades