Efficiency of cellular information processing

Abstract

We show that a rate of conditional Shannon entropy reduction, characterizing the learning of an internal process about an external process, is bounded by the thermodynamic entropy production. This approach allows for the definition of an informational efficiency that can be used to study cellular information processing. We analyze three models of increasing complexity inspired by the E. coli sensory network, where the external process is an external ligand concentration jumping between two values. We start with a simple model for which ATP must be consumed so that a protein inside the cell can learn about the external concentration. With a second model for a single receptor we show that the rate at which the receptor learns about the external environment can be nonzero even without any dissipation inside the cell since chemical work done by the external process compensates for this learning rate. The third model is more complete, also containing adaptation. For this model we show inter alia that a bacterium in an environment that changes at a very slow time-scale is quite inefficient, dissipating much more than it learns. Using the concept of a coarse-grained learning rate, we show for the model with adaptation that while the activity learns about the external signal the option of changing the methylation level increases the concentration range for which the learning rate is substantial.

18 pages, 7 figures

References in corpus (31)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• Information heat engine: converting information to energy by feedback control
• Generalized Jarzynski Equality under Nonequilibrium Feedback Control
• Stochastic thermodynamics under coarse-graining
• Work and information processing in a solvable model of Maxwell's demon
• Nonequilibrium Thermodynamics of Feedback Control
• The thermodynamics of prediction
• The Energetic Costs of Cellular Computation
• Thermodynamics with continuous information flow
• Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
• Information-theoretic approach to the study of control systems
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
• Information-Theoretic Limits of Control
• Thermodynamic costs of information processing in sensory adaption
• Thermodynamics of feedback controlled systems
• Information Thermodynamics on Causal Networks
• Unifying Three Perspectives on Information Processing in Stochastic Thermodynamics
• Stochastic thermodynamics of single enzymes and molecular motors
• Efficiency of autonomous soft nano-machines at maximum power
• Thermodynamics of genuine non-equilibrium states under feedback control
• Stochastic thermodynamics for "Maxwell demon" feedbacks
• Kinetic vs. energetic discrimination in biological copying
• An autonomous and reversible Maxwell's demon
• Thermodynamic efficiency of information and heat flow
• Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
• Chemical sensing by nonequilibrium cooperative receptors
• Rate of mutual information between coarse-grained non-Markovian variables
• Mutual Entropy-Production and Sensing in Bipartite Systems
• Unraveling Adaptation in Eukaryotic Pathways: Lessons from Protocells
• Prediction and Dissipation in Biochemical Sensing
• How biochemical resources determine fundamental limits in cellular sensing

Cited by in corpus (95)

• Thermodynamic uncertainty relation for biomolecular processes
• Cost and Precision of Brownian Clocks
• Maxwell's demon in biochemical signal transduction with feedback loop
• Uncertainty relations in stochastic processes: An information inequality approach
• Theory of nonequilibrium free energy transduction by molecular machines
• Stochastic thermodynamic interpretation of information geometry
• Stochastic time-evolution, information geometry and the Cramer-Rao Bound
• Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes
• Hierarchical Bounds on Entropy Production Inferred from Partial Information
• Sensory capacity: an information theoretical measure of the performance of a sensor
• Multipartite information flow for multiple Maxwell demons
• Physical limit to concentration sensing amid spurious ligands
• The thermodynamics of computational copying in biochemical systems
• Nonequilibrium sensing and its analogy to kinetic proofreading
• Coherence of Biochemical Oscillations is Bounded by Driving Force and Network Topology
• Thermodynamic Bound on the Asymmetry of Cross-Correlations
• Biochemical machines for the interconversion of mutual information and work
• Thermodynamically Consistent Coarse Graining of Biocatalysts beyond Michaelis--Menten
• Stochastic Thermodynamics of Learning
• Landauer in the age of synthetic biology: energy consumption and information processing in biochemical networks
• Thermodynamic limits to information harvesting by sensory systems
• Entropy production in exactly solvable systems
• Thermodynamics of Chemical Waves
• Thermodynamics of accuracy in kinetic proofreading: Dissipation and efficiency trade-offs
• Efficiency fluctuations and noise induced refrigerator-to-heater transition in information engines
• Thermodynamic cost of external control
• Universal minimal cost of coherent biochemical oscillations
• Fundamental limitations on photoisomerization from thermodynamic resource theories
• Receptor crosstalk improves concentration sensing of multiple ligands
• Nonequilibrium uncertainty principle from information geometry
• Violation of Local Detailed Balance Despite a Clear Time-Scale Separation
• Know the single-receptor sensing limit? Think again
• Critical behavior of entropy production and learning rate: Ising model with an oscillating field
• Energy and information flows in autonomous systems
• Thermodynamics of stochastic Turing machines
• Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality
• Thermodynamics and computation during collective motion near criticality
• Unified framework for the entropy production and the stochastic interaction based on information geometry
• Continuous information flow fluctuations
• Linear Irreversible Thermodynamics and Onsager Reciprocity for Information-driven Engines
• Information thermodynamics for interacting stochastic systems without bipartite structure
• Thermodynamic aspects of information transfer in complex dynamical systems
• Stochastic thermodynamics of periodically driven systems: Fluctuation theorem for currents and unification of two classes
• Reaching and violating thermodynamic uncertainty bounds in information engines
• What we learn from the learning rate
• A connection between bacterial chemotactic network and optimal filtering
• A universal tradeoff between power, precision and speed in physical communication
• Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation
• Energy dissipation in an adaptive molecular circuit
• Internal energy and information flows mediate input and output power in bipartite molecular machines
• Precision and dissipation of a stochastic Turing pattern
• Universal bounds on the performance of information-thermodynamic engine
• Nonequilibrium thermodynamics and information theory: Basic concepts and relaxing dynamics
• Biochemical Szilard engines for memory-limited inference
• Drift and behavior of E. coli cells
• Dispersion for Two Classes of Random Variables: General Theory and Application to Inference of an External Ligand Concentration by a Cell
• Trade-offs in delayed information transmission in biochemical networks
• Designing the Optimal Bit: Balancing Energetic Cost, Speed and Reliability
• Adaptive heat engine
• Thermodynamics of collective enhancement of precision
• Free-energy transduction within autonomous systems
• Jarzynski-type equalities in gambling: role of information in capital growth
• Optimal inference strategies and their implications for the linear noise approximation
• Biological implications of dynamical phases in non-equilibrium networks
• Pleiotropy enables specific and accurate signaling in the presence of ligand cross talk
• Universal bounds on optimization of free energy harvesting
• Multi-dimensional biochemical information processing of dynamical patterns
• Quantifying configurational information for a stochastic particle in a flow-field
• Allostery and Kinetic Proofreading
• Information Arbitrage in Bipartite Heat Engines
• Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities
• Maxwell's demons with finite size and response time
• Thermodynamic efficiency of learning a rule in neural networks
• Decomposing Thermodynamic Dissipation of Linear Langevin Systems via Oscillatory Modes and Its Application to Neural Dynamics
• Experimentally probing entropy reduction via iterative quantum information transfer
• Dispersion of the time spent in a state: General expression for unicyclic model and dissipation-less precision
• Information in feedback ratchets
• A universal lower bound on the free energy cost of molecular measurements
• Thermodynamic role of main reaction pathway and multi-body information flow in membrane transport
• Optimal temporal patterns for dynamical cellular signaling
• Thermodynamics of Encoding and Encoders
• Thermodynamics of Darwinian selection in molecular replicators
• Energy dissipation and information flow in coupled Markovian systems
• Foundations of Stochastic Thermodynamics
• Dissipation in non-steady state regulatory circuits
• Framework for fluctuating times and counting observables in stochastic excursions
• Minimal entropy production due to constraints on rate matrix dependencies in multipartite processes
• Counting observables in stochastic excursions
• Detecting concentration changes with cooperative receptors
• Information bounds production in replicator systems
• Thermodynamic inference in molecular motors: a Martingale approach
• Fluctuation theorems for multiple co-evolving systems
• Functional Decomposition and Estimation of Irreversibility in Time Series via Machine Learning
• Information-thermodynamic characterization of stochastic Boolean networks
• Emergence of Nonequilibrium Latent Cycles in Unsupervised Generative Modeling