Relative Entropy in Biological Systems

Abstract

In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe the dynamics of a population or probability distribution. Under suitable assumptions, the distribution will approach an equilibrium with the passage of time. Relative entropy - that is, the Kullback--Leibler divergence, or various generalizations of this - provides a quantitative measure of how far from equilibrium the system is. We explain various theorems that give conditions under which relative entropy is nonincreasing. In biochemical applications these results can be seen as versions of the Second Law of Thermodynamics, stating that free energy can never increase with the passage of time. In ecological applications, they make precise the notion that a population gains information from its environment as it approaches equilibrium.

20 pages

References in corpus (2)

• Information Geometry and Evolutionary Game Theory
• Open Markov processes: A compositional perspective on non-equilibrium steady states in biology

Cited by in corpus (10)

• Universal Darwinism as a process of Bayesian inference
• Bounding generalized relative entropies: Nonasymptotic quantum speed limits
• Quantifying Energy Conversion in Higher Order Phase Space Density Moments in Plasmas
• Open Markov processes: A compositional perspective on non-equilibrium steady states in biology
• The Fundamental Theorem of Natural Selection
• Landauer's principle as a special case of Galois connection
• Limits on the Evolutionary Rates of Biological Traits
• Periodic orbits in deterministic discrete-time evolutionary game dynamics: An information-theoretic perspective
• Einstein's equations and the pseudo-entropy of pseudo-Riemannian information manifolds
• Momentum Accelerates Evolutionary Dynamics