Sensory capacity: an information theoretical measure of the performance of a sensor

Abstract

For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as much information about a signal as the whole time-series of the sensor. We show that adding a memory to the sensor increases the sensory capacity. This increase quantifies the improvement of the sensor with the addition of the memory. Our results are obtained with the framework of stochastic thermodynamics of bipartite systems, which allows for the definition of an efficiency that relates the rate with which the sensor learns about the signal with the energy dissipated by the sensor, which is given by the thermodynamic entropy production. We demonstrate a general tradeoff between sensory capacity and efficiency: if the sensory capacity is equal to its maximum 1, then the efficiency must be less than 1/2. As a physical realization of a sensor we consider a two component cellular network estimating a fluctuating external ligand concentration as signal. This model leads to coupled linear Langevin equations that allow us to obtain explicit analytical results.

15 pages, 7 figures

References in corpus (24)

• Second Law of Thermodynamics with Discrete Quantum Feedback Control
• High-precision test of Landauer's principle in a feedback trap
• Work and information processing in a solvable model of Maxwell's demon
• Experimental study of mutual information in a Maxwell Demon
• The thermodynamics of prediction
• Thermodynamics of a physical model implementing a Maxwell demon
• Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
• Extracting work from a single heat bath through feedback
• Thermodynamic costs of information processing in sensory adaption
• Efficiency of cellular information processing
• Thermodynamics of feedback controlled systems
• Maxwell's demon in biochemical signal transduction with feedback loop
• Fluctuation Theorem for Partially-masked Nonequilibrium Dynamics
• Second-law-like inequalities with information and their interpretations
• Thermodynamics of statistical inference by cells
• Stochastic thermodynamics with information reservoirs
• Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
• Efficiency of a Brownian information machine
• Multipartite information flow for multiple Maxwell demons
• Nonequilibrium sensing and its analogy to kinetic proofreading
• Stochastic thermodynamics of Langevin systems under time-delayed feedback control: I. Second-law-like inequalities
• Role of measurement-feedback separation in autonomous Maxwell's demons
• Hidden Markov models for stochastic thermodynamics
• Optimized finite-time information machine

Cited by in corpus (42)

• Semantic information, autonomous agency, and nonequilibrium statistical physics
• Uncertainty relations in stochastic processes: An information inequality approach
• Theory of nonequilibrium free energy transduction by molecular machines
• Irreversibility, heat and information flows induced by non-reciprocal interactions
• Stochastic thermodynamic interpretation of information geometry
• Stochastic Thermodynamics of Learning
• Thermodynamic cost of external control
• Critical behavior of entropy production and learning rate: Ising model with an oscillating field
• Energy and information flows in autonomous systems
• Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality
• Continuous information flow fluctuations
• Information thermodynamics for interacting stochastic systems without bipartite structure
• Linear Irreversible Thermodynamics and Onsager Reciprocity for Information-driven Engines
• Measurement-feedback formalism meets information reservoirs
• What we learn from the learning rate
• Information-theoretic analysis of the directional influence between cellular processes
• Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation
• Universal bounds on the performance of information-thermodynamic engine
• Fluctuations When Driving Between Nonequilibrium Steady States
• Thermodynamics of collective enhancement of precision
• Universal Response Inequalities Beyond Steady States via Trajectory Information Geometry
• Optimal inference strategies and their implications for the linear noise approximation
• Influence of time delay on information exchanges between coupled linear stochastic systems
• Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities
• Information Arbitrage in Bipartite Heat Engines
• Entropy balance and Information processing in bipartite and non-bipartite composite systems
• When memory pays: Discord in hidden Markov models
• Optimal Work Extraction and the Minimum Description Length Principle
• Non-reciprocal hidden degrees of freedom: A unifying perspective on memory, feedback, and activity
• Experimentally probing entropy reduction via iterative quantum information transfer
• Thermodynamic role of main reaction pathway and multi-body information flow in membrane transport
• Theory for Optimal Estimation and Control under Resource Limitations and Its Applications to Biological Information Processing and Decision-Making
• Energy dissipation and information flow in coupled Markovian systems
• Resource Limitations induce Phase Transitions in Biological Information Processing
• Dissipation in non-steady state regulatory circuits
• Minimal entropy production due to constraints on rate matrix dependencies in multipartite processes
• Fluctuation theorems for multiple co-evolving systems
• Information-thermodynamic characterization of stochastic Boolean networks
• Individual Sensing can Gain more Fitness than its Information
• Defining and finding lifelike entities with a lazy filter
• How to measure heat in stochastic systems
• Acceleration of enzymatic reactions due to nearby inactive binding sites