Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems

Abstract

The irreversibility of a stationary time series can be quantified using the Kullback-Leibler divergence (KLD) between the probability to observe the series and the probability to observe the time-reversed series. Moreover, this KLD is a tool to estimate entropy production from stationary trajectories since it gives a lower bound to the entropy production of the physical process generating the series. In this paper we introduce analytical and numerical techniques to estimate the KLD between time series generated by several stochastic dynamics with a finite number of states. We examine the accuracy of our estimators for a specific example, a discrete flashing ratchet, and investigate how close is the KLD to the entropy production depending on the number of degrees of freedom of the system that are sampled in the trajectories.

14 pages, 7 figures

References in corpus (8)

• Dissipation: The phase-space perspective
• Rare events and the convergence of exponentially averaged work values
• Nonequilibrium fluctuations in a resistor
• Power and heat fluctuation theorems for electric circuits
• Lower bounds on dissipation upon coarse graining
• The "footprints'' of irreversibility
• An illustrative example of the relationship between dissipation and relative entropy
• Fluctuation theorem for entropy production during effusion of a relativistic ideal gas

Cited by in corpus (63)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• Universal bounds on current fluctuations
• Time series irreversibility: a visibility graph approach
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
• Broken detailed balance and entropy production in the human brain
• Universal bound on the efficiency of molecular motors
• Inferring broken detailed balance in the absence of observable currents
• Theory of nonequilibrium free energy transduction by molecular machines
• Time-(ir)reversibility in active matter: from micro to macro
• Non-Markovianity and negative entropy production rates
• Unified Approach to Classical Speed Limit and Thermodynamic Uncertainty Relation
• Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes
• Quantifying hidden order out of equilibrium
• Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
• Play. Pause. Rewind. Measuring local entropy production and extractable work in active matter
• Entropy production and fluctuation theorems for Langevin processes under continuous non-Markovian feedback control
• Time reversibility from visibility graphs of non-stationary processes
• Learning entropy production via neural networks
• Stochastic thermodynamics of Langevin systems under time-delayed feedback control: I. Second-law-like inequalities
• Rate of mutual information between coarse-grained non-Markovian variables
• Milestoning estimators of dissipation in systems observed at a coarse resolution: When ignorance is truly bliss
• Mutual Entropy-Production and Sensing in Bipartite Systems
• Second law for active heat engines
• Tightest bound on hidden entropy production from partially observed dynamics
• Violation of Local Detailed Balance Despite a Clear Time-Scale Separation
• Quantifying time irreversibility using probabilistic differences between symmetric permutations
• Multiplex decomposition of non-Markovian dynamics and the hidden layer reconstruction problem
• Information thermodynamics for interacting stochastic systems without bipartite structure
• Thermodynamic uncertainty relation for time-delayed Langevin systems
• Uncertainty relations for time-delayed Langevin systems
• The arrow of time across five centuries of classical music
• Transport and Energetics of Bacterial Rectification
• Scale-dependent irreversibility in living matter
• On the emergence of memory in equilibrium versus non-equilibrium systems
• Dissipative timescales from coarse-graining irreversibility
• Conceptual and practical approaches for investigating irreversible processes
• Variance sum rule: proofs and solvable models
• An estimator of entropy production for partially accessible Markov networks based on the observation of blurred transitions
• Estimating entropy production in a stochastic system with odd-parity variables
• Entropy estimation for partially accessible Markov networks based on imperfect observations: Role of finite resolution and finite statistics
• Estimating entropy rate from censored symbolic time series: a test for time-irreversibility
• Optimal Work Extraction and the Minimum Description Length Principle
• Thermodynamic inference in partially accessible Markov networks: A unifying perspective from transition-based waiting time distributions
• Influence of cumulative damage on synchronization of Kuramoto oscillators on networks
• Gibbs-Jaynes Entropy Versus Relative Entropy
• Inferring entropy production in many-body systems using nonequilibrium maximum entropy
• Time-irreversibility tests for random-length time series: the matching-time approach applied to DNA
• Quantifying the non-equilibrium activity of an active colloid
• Kullback-Leibler cluster entropy to quantify volatility correlation and risk diversity
• Inferring nonequilibrium thermodynamics from tilted equilibrium using information-geometric Legendre transform
• Thermodynamic bounds and symmetries in first-passage problems of fluctuating currents
• First-Passage-Time Asymmetry for Biased Run-and-Tumble Processes
• On the Ziv-Merhav theorem beyond Markovianity
• Irreversibility of symbolic time series: a cautionary tale
• Force-free kinetic inference of entropy production
• Remark on the Entropy Production of Adaptive Run-and-Tumble Chemotaxis
• Identifying statistical indicators of temporal asymmetry using a data-driven approach
• A unified framework of unitarily residual measures for quantifying dissipation
• Non-equilibrium structure and relaxation in active microemulsions
• Ziv-Merhav estimation for hidden-Markov processes
• Inferring entropy production rate from partially observed Langevin dynamics under coarse-graining
• Information loss and entropy production during dissipative processes in a macroscopic system kicked out of the equilibrium
• Inducing and optimizing Markovian Mpemba effect with stochastic reset