Entropy: The Markov Ordering Approach

Abstract

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {\em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.

50 pages, 4 figures, Postprint version. More detailed discussion of the various entropy additivity properties and separation of variables for independent subsystems in MaxEnt problem is added in Section 4.2. Bibliography is extended

References in corpus (1)

• Monotonically equivalent entropies and solution of additivity equation

Cited by in corpus (19)

• The resource theory of informational nonequilibrium in thermodynamics
• Quasichemical Models of Multicomponent Nonlinear Diffusion
• The Michaelis-Menten-Stueckelberg Theorem
• Relative Entropy in Biological Systems
• Bounded rational decision-making from elementary computations that reduce uncertainty
• Generalized information entropies depending only on the probability distribution
• General H-theorem and entropies that violate the second law
• Maxallent: Maximizers of all Entropies and Uncertainty of Uncertainty
• Grasping Complexity
• Modified entropies as the origin of generalized uncertainty principles
• Thermodynamic Tree: The Space of Admissible Paths
• Le Chatelier principle in replicator dynamics
• Possibility and Impossibility of the Entropy Balance in Lattice Boltzmann Collisions
• Local Equivalence of Reversible and General Markov Kinetics
• A Second Law for Open Markov Processes
• Investigation of Finite-size 2D Ising Model with a Noisy Matrix of Spin-Spin Interactions
• New universal Lyapunov functions for non-linear reaction networks
• Inferring nonequilibrium thermodynamics from tilted equilibrium using information-geometric Legendre transform
• Universal Gorban's Entropies: Geometric Case Study