Information thermodynamics for interacting stochastic systems without bipartite structure
arXiv:1905.06216 · doi:10.1088/1742-5468/ab47fe
Abstract
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or information thermodynamics. This means that fluctuations in each subsystem are not independent: subsystems jump simultaneously if the dynamics is modeled as a Markov jump process, or noises are correlated for diffusion processes. In this paper, we consider information and thermodynamic exchanges between a pair of coupled systems that do not satisfy the bipartite property. The generalization of information-theoretic measures, such as learning rates and transfer entropy rates, to this situation is non-trivial and also involves introducing several additional rates. We describe how this can be achieved in the framework of general continuous-time Markov processes, without restricting the study to the steady-state regime. We illustrate our general formalism on the case of diffusion processes and derive an extension of the second law of information thermodynamics in which the difference of transfer entropy rates in the forward and backward time directions replaces the learning rate. As a side result, we also generalize an important relation linking information theory and estimation theory. To further obtain analytical expressions we treat in detail the case of Ornstein-Uhlenbeck processes, and discuss the ability of the various information measures to detect a directional coupling in the presence of correlated noises. Finally, we apply our formalism to the analysis of the directional influence between cellular processes in a concrete example, which also requires considering the case of a non-bipartite and non-Markovian process.
arXiv comment39 pages, 5 figures. Final version, to appear in J. Stat.Mech
References in corpus (33)
- Measuring Information Transfer
- Granger causality and transfer entropy are equivalent for Gaussian variables
- Ensemble and Trajectory Thermodynamics: A Brief Introduction
- State-dependent diffusion: thermodynamic consistency and its path integral formulation
- Nonequilibrium Thermodynamics of Feedback Control
- Thermodynamics with continuous information flow
- Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
- Efficiency of cellular information processing
- Information Thermodynamics on Causal Networks
- Maxwell's demon in biochemical signal transduction with feedback loop
- Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems
- Fluctuation Theorem for Partially-masked Nonequilibrium Dynamics
- Signal detection, modularity and the correlation between extrinsic and intrinsic noise in biochemical networks
- Fluctuation Relations for Diffusion Processes
- The relation between Granger causality and directed information theory: a review
- Thermodynamic efficiency of information and heat flow
- Sensory capacity: an information theoretical measure of the performance of a sensor
- Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
- Validity of time reversal for testing Granger causality
- Optimal Prediction by Cellular Signaling Networks
- Multipartite information flow for multiple Maxwell demons
- Rate of mutual information between coarse-grained non-Markovian variables
- Maximum work extraction and implementation costs for non-equilibrium Maxwell's demons
- Mutual Entropy-Production and Sensing in Bipartite Systems
- Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality
- Continuous information flow fluctuations
- Noise Filtering and Prediction in Biological Signaling Networks
- Information-theoretic analysis of the directional influence between cellular processes
- Universal Form of Stochastic Evolution for Slow Variables in Equilibrium Systems
- Characterising information-theoretic storage and transfer in continuous time processes
- Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation
- Influence of time delay on information exchanges between coupled linear stochastic systems
- Entropy balance and Information processing in bipartite and non-bipartite composite systems
Cited by in corpus (11)
- Energy and information flows in autonomous systems
- Universal bounds on the performance of information-thermodynamic engine
- Flow of Energy and Information in Molecular Machines
- Internal energy and information flows mediate input and output power in bipartite molecular machines
- Unlocking the potential of information flow: Maximizing free-energy transduction in a model of an autonomous rotary molecular motor
- Information Arbitrage in Bipartite Heat Engines
- Information Thermodynamics of the Transition-Path Ensemble
- Optimal Work Extraction and the Minimum Description Length Principle
- Jensen bound for the entropy production rate in stochastic thermodynamics
- Strong current response to slow modulation: a metabolic case-study
- Unravelling the Flow of Information in a Nonequilibrium Process in the Presence of Hydrodynamic Interactions