Markov processes follow from the principle of Maximum Caliber

Abstract

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible dynamical trajectories in a time-homogeneous process, then the only type of process that maximizes the path entropy, for any given singlet statistics, is a sequence of identical, independently distributed (i.i.d.) random variables, which is the simplest Markov process. If the data is in the form of sequentially pairwise statistics, then maximizing the caliber dictates that the process is Markovian with a uniform initial distribution. Furthermore, if an initial non-uniform dynamical distribution is known, or multiple trajectories are conditioned on an initial state, then the Markov process is still the only one that maximizes the caliber. Second, given a model, MaxCal can be used to compute the parameters of that model. We show that this procedure is equivalent to the maximum-likelihood method of inference in the theory of statistics.

4 pages

References in corpus (1)

• Non-equilibrium steady states : maximization of the Shannon entropy associated to the distribution of dynamical trajectories in the presence of constraints

Cited by in corpus (17)

• Maximum Caliber: a general variational principle for dynamical systems
• A framework towards understanding mesoscopic phenomena: Emergent unpredictability, symmetry breaking and dynamics across scales
• Path sampling of recurrent neural networks by incorporating known physics
• A derivation of the master equation from path entropy maximization
• Maximum caliber is a general variational principle for nonequilibrium statistical mechanics
• Nonequilibrium thermodynamics of the asymmetric Sherrington-Kirkpatrick model
• Stochastic Physics, Complex Systems and Biology
• Newtonian Dynamics from the principle of Maximum Caliber
• Maximum Caliber Inference and the Stochastic Ising Model
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Stationary properties of maximum entropy random walks
• The derivation of Markov processes that violate detailed balance
• Microcanonical Origin of the Maximum Entropy Principle for Open Systems
• Stochastic Distinguishability of Markovian Trajectories
• Correspondence between temporal correlations in time series, inverse problems, and the Spherical Model
• Small Open Chemical Systems Theory and Its Implications to Darwinian Evolutionary Dynamics, Complex Self-Organization and Beyond
• Microcanonical ensemble out of equilibrium