Stochastic Distinguishability of Markovian Trajectories

Abstract

The ability to distinguish between stochastic systems based on their trajectories is crucial in thermodynamics, chemistry, and biophysics. The Kullback-Leibler (KL) divergence, $D_{\text{KL}}^{AB}(0,\tau )$, quantifies the distinguishability between the two ensembles of length-$\tau$ trajectories from Markov processes A and B. However, evaluating $D_{\text{KL}}^{AB}(0,\tau )$ from histograms of trajectories faces sufficient sampling difficulties, and no theory explicitly reveals what dynamical features contribute to the distinguishability. This letter provides a general formula that decomposes $D_{\text{KL}}^{AB}(0,\tau )$ in space and time for any Markov processes, arbitrarily far from equilibrium or steady state. It circumvents the sampling difficulty of evaluating $D_{\text{KL}}^{AB}(0,\tau )$. Furthermore, it explicitly connects trajectory KL divergence with individual transition events and their waiting time statistics. The results provide insights into understanding distinguishability between Markov processes, leading to new theoretical frameworks for designing biological sensors and optimizing signal transduction.

References in corpus (26)

• A nonequilibrium equality for free energy differences
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• Dynamical Ensembles in Nonequilibrium Statistical Mechanics
• Stochastic thermodynamics: Principles and perspectives
• Random Walks, Markov Processes and the Multiscale Modular Organization of Complex Networks
• Laplacian Dynamics and Multiscale Modular Structure in Networks
• Anomalous cooling and heating - the Mpemba effect and its inverse
• Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
• Inferring broken detailed balance in the absence of observable currents
• The Mpemba index and anomalous relaxation
• Fluctuation Relations for Diffusion Processes
• Markovian Dynamics on Complex Reaction Networks
• Two refreshing views of Fluctuation Theorems through Kinematics Elements and Exponential Martingale
• Theoretical Perspectives on Biological Machines
• Response theory: a trajectory-based approach
• Markov processes follow from the principle of Maximum Caliber
• Averaging and large deviation principles for fully-coupled piecewise deterministic Markov processes and applications to molecular motors
• Fluctuation Relations for Diffusions Thermally Driven by a Non-Stationnary Bath
• Inflow rate, a time-symmetric observable obeying fluctuation relations
• Path Weight Sampling: Exact Monte Carlo Computation of the Mutual Information between Stochastic Trajectories
• Martingale structure for general thermodynamic functionals of diffusion processes under second-order averaging
• Non-equilibrium Markov state modeling of periodically driven biomolecules
• Sloppy Gear Mechanism for Coupled Stochastic Transportation: from anti-equilibrium flow to infinite selectivity
• Accurate sensing of multiple ligands with a single receptor
• Theoretical upper bound of multiplexing in stochastic sensory receptors
• A Stochastic Markov Model for Coordinated Molecular Motors

Cited by in corpus (2)

• Universal Response Inequalities Beyond Steady States via Trajectory Information Geometry
• Information Benchmark for Biological Sensors Beyond Steady States -- Mpemba-like sensory withdrawal effect