Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks

Abstract

For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we find that there is no universal bound restricting the rate of obtaining information to be less than this thermodynamic cost. These results are obtained within a general bipartite model consisting of a stochastically changing environment that affects the instantaneous transition rates within the system. Moreover, they are illustrated with a simple four-states model motivated by cellular sensing. On the technical level, we obtain an upper bound on the rate of mutual information analytically and calculate this rate with a numerical method that estimates the entropy of a time-series generated with a simulation.

6 pages, 4 figures

References in corpus (19)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• A Gallavotti-Cohen Type Symmetry in the Large Deviation Functional for Stochastic Dynamics
• The Physics of Maxwell's demon and information
• Generalized Jarzynski Equality under Nonequilibrium Feedback Control
• Thermodynamic formalism for systems with Markov dynamics
• Work and information processing in a solvable model of Maxwell's demon
• The Energetic Costs of Cellular Computation
• Information-theoretic approach to the study of control systems
• Mutual information between in- and output trajectories of biochemical networks
• Information transmission in genetic regulatory networks: a review
• Information-Theoretic Limits of Control
• Thermodynamics of feedback controlled systems
• Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems
• Maximum likelihood and the single receptor
• Thermodynamics of genuine non-equilibrium states under feedback control
• Stochastic thermodynamics for "Maxwell demon" feedbacks
• Limits of sensing temporal concentration changes by single cells
• Designing optimal discrete-feedback thermodynamic engines
• Mutual information in time-varying biochemical systems

Cited by in corpus (52)

• Thermodynamic uncertainty relation for biomolecular processes
• Nonequilibrium Physics in Biology
• Thermodynamics with continuous information flow
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
• Thermodynamic costs of information processing in sensory adaption
• Efficiency of cellular information processing
• Information Thermodynamics on Causal Networks
• Cost and Precision of Brownian Clocks
• Fluctuation Theorem for Partially-masked Nonequilibrium Dynamics
• Second-law-like inequalities with information and their interpretations
• Thermodynamics of statistical inference by cells
• Sensory capacity: an information theoretical measure of the performance of a sensor
• The thermodynamics of computational copying in biochemical systems
• Nonequilibrium sensing and its analogy to kinetic proofreading
• Coherence of Biochemical Oscillations is Bounded by Driving Force and Network Topology
• Thermodynamic Bound on the Asymmetry of Cross-Correlations
• Landauer in the age of synthetic biology: energy consumption and information processing in biochemical networks
• Thermodynamic limits to information harvesting by sensory systems
• Rate of mutual information between coarse-grained non-Markovian variables
• Thermodynamic cost of external control
• Maximum work extraction and implementation costs for non-equilibrium Maxwell's demons
• Mutual Entropy-Production and Sensing in Bipartite Systems
• Physical constraints in intracellular signaling: the cost of sending a bit
• Energy and information flows in autonomous systems
• Thermodynamics of stochastic Turing machines
• Emergence of local irreversibility in complex interacting systems
• Linear Irreversible Thermodynamics and Onsager Reciprocity for Information-driven Engines
• Information thermodynamics for interacting stochastic systems without bipartite structure
• Thermodynamic aspects of information transfer in complex dynamical systems
• Dynamic and thermodynamic bounds for collective motor-driven transport
• Total cost of operating an information engine
• What we learn from the learning rate
• Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation
• Effective thermodynamics of two interacting underdamped Brownian particles
• Dispersion for Two Classes of Random Variables: General Theory and Application to Inference of an External Ligand Concentration by a Cell
• Trade-offs in delayed information transmission in biochemical networks
• Adaptive heat engine
• Optimal inference strategies and their implications for the linear noise approximation
• Unlocking the potential of information flow: Maximizing free-energy transduction in a model of an autonomous rotary molecular motor
• Biological implications of dynamical phases in non-equilibrium networks
• Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities
• Maxwell's demons with finite size and response time
• Thermodynamic efficiency of learning a rule in neural networks
• A universal lower bound on the free energy cost of molecular measurements
• Dispersion of the time spent in a state: General expression for unicyclic model and dissipation-less precision
• Application of Mutual Information Methods in Time-Distance Helioseismology
• Dissipation in non-steady state regulatory circuits
• Stochastic Thermodynamics of Non-reciprocally Interacting Particles and Fields
• Detecting concentration changes with cooperative receptors
• Bounds on the rates of statistical divergences and mutual information via stochastic thermodynamics
• Optimizing Energetic cost of Uncertainty in a Driven System With and Without Feedback
• Global-Local Duality of Energetic Control Cost in Multipartite Quantum Correlated Systems