Sensory capacity: an information theoretical measure of the performance of a sensor
arXiv:1509.02111 · doi:10.1103/PhysRevE.93.022116
Abstract
For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as much information about a signal as the whole time-series of the sensor. We show that adding a memory to the sensor increases the sensory capacity. This increase quantifies the improvement of the sensor with the addition of the memory. Our results are obtained with the framework of stochastic thermodynamics of bipartite systems, which allows for the definition of an efficiency that relates the rate with which the sensor learns about the signal with the energy dissipated by the sensor, which is given by the thermodynamic entropy production. We demonstrate a general tradeoff between sensory capacity and efficiency: if the sensory capacity is equal to its maximum 1, then the efficiency must be less than 1/2. As a physical realization of a sensor we consider a two component cellular network estimating a fluctuating external ligand concentration as signal. This model leads to coupled linear Langevin equations that allow us to obtain explicit analytical results.
arXiv comment15 pages, 7 figures
References in corpus (54)
- Measuring Information Transfer
- Stochastic thermodynamics, fluctuation theorems, and molecular machines
- Information heat engine: converting information to energy by feedback control
- Generalized Jarzynski Equality under Nonequilibrium Feedback Control
- Second Law of Thermodynamics with Discrete Quantum Feedback Control
- High-precision test of Landauer's principle in a feedback trap
- Stochastic thermodynamics under coarse-graining
- Work and information processing in a solvable model of Maxwell's demon
- Experimental study of mutual information in a Maxwell Demon
- Nonequilibrium Thermodynamics of Feedback Control
- The thermodynamics of prediction
- Thermodynamics of a physical model implementing a Maxwell demon
- The Energetic Costs of Cellular Computation
- Thermodynamics with continuous information flow
- Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
- Information processing and the second law of thermodynamics: an inclusive, Hamiltonian approach
- Universal features in the energetics of symmetry breaking
- Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
- Extracting work from a single heat bath through feedback
- Thermodynamic costs of information processing in sensory adaption
- Efficiency of cellular information processing
- Thermodynamics of feedback controlled systems
- Information Thermodynamics on Causal Networks
- Maxwell's demon in biochemical signal transduction with feedback loop
- Fluctuation Theorem for Partially-masked Nonequilibrium Dynamics
- Maxwell's Refrigerator: An Exactly Solvable Model
- Second-law-like inequalities with information and their interpretations
- Thermodynamic Reversibility in Feedback Processes
- Unifying Three Perspectives on Information Processing in Stochastic Thermodynamics
- Thermodynamics of genuine non-equilibrium states under feedback control
- Imitating Chemical Motors with Optimal Information Motors
- Thermodynamics of statistical inference by cells
- An autonomous and reversible Maxwell's demon
- Thermodynamic efficiency of information and heat flow
- Stochastic thermodynamics with information reservoirs
- Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
- Efficiency of a Brownian information machine
- Multipartite information flow for multiple Maxwell demons
- Nonequilibrium sensing and its analogy to kinetic proofreading
- The thermodynamic cost of measurements
- Chemical sensing by nonequilibrium cooperative receptors
- Stochastic thermodynamics of Langevin systems under time-delayed feedback control: I. Second-law-like inequalities
- Information driven current in a quantum Maxwell demon
- Role of measurement-feedback separation in autonomous Maxwell's demons
- Thermodynamic limits to information harvesting by sensory systems
- Hidden Markov models for stochastic thermodynamics
- Rate of mutual information between coarse-grained non-Markovian variables
- Entropy production and fluctuation theorems under feedback control: the molecular refrigerator model revisited
- Mutual Entropy-Production and Sensing in Bipartite Systems
- Maximum work extraction and implementation costs for non-equilibrium Maxwell's demons
- On the energetics of information exchange
- Memory improves precision of cell sensing in fluctuating environments
- Unraveling Adaptation in Eukaryotic Pathways: Lessons from Protocells
- Optimized finite-time information machine
Cited by in corpus (42)
- Semantic information, autonomous agency, and nonequilibrium statistical physics
- Uncertainty relations in stochastic processes: An information inequality approach
- Theory of nonequilibrium free energy transduction by molecular machines
- Irreversibility, heat and information flows induced by non-reciprocal interactions
- Stochastic thermodynamic interpretation of information geometry
- Stochastic Thermodynamics of Learning
- Thermodynamic cost of external control
- Critical behavior of entropy production and learning rate: Ising model with an oscillating field
- Energy and information flows in autonomous systems
- Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality
- Continuous information flow fluctuations
- Information thermodynamics for interacting stochastic systems without bipartite structure
- Linear Irreversible Thermodynamics and Onsager Reciprocity for Information-driven Engines
- Measurement-feedback formalism meets information reservoirs
- What we learn from the learning rate
- Information-theoretic analysis of the directional influence between cellular processes
- Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation
- Universal bounds on the performance of information-thermodynamic engine
- Fluctuations When Driving Between Nonequilibrium Steady States
- Thermodynamics of collective enhancement of precision
- Universal Response Inequalities Beyond Steady States via Trajectory Information Geometry
- Optimal inference strategies and their implications for the linear noise approximation
- Influence of time delay on information exchanges between coupled linear stochastic systems
- Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities
- Information Arbitrage in Bipartite Heat Engines
- Entropy balance and Information processing in bipartite and non-bipartite composite systems
- When memory pays: Discord in hidden Markov models
- Optimal Work Extraction and the Minimum Description Length Principle
- Non-reciprocal hidden degrees of freedom: A unifying perspective on memory, feedback, and activity
- Experimentally probing entropy reduction via iterative quantum information transfer
- Thermodynamic role of main reaction pathway and multi-body information flow in membrane transport
- Theory for Optimal Estimation and Control under Resource Limitations and Its Applications to Biological Information Processing and Decision-Making
- Energy dissipation and information flow in coupled Markovian systems
- Resource Limitations induce Phase Transitions in Biological Information Processing
- Dissipation in non-steady state regulatory circuits
- Minimal entropy production due to constraints on rate matrix dependencies in multipartite processes
- Fluctuation theorems for multiple co-evolving systems
- Information-thermodynamic characterization of stochastic Boolean networks
- Individual Sensing can Gain more Fitness than its Information
- Defining and finding lifelike entities with a lazy filter
- How to measure heat in stochastic systems
- Acceleration of enzymatic reactions due to nearby inactive binding sites