Stochastic Distinguishability of Markovian Trajectories

Abstract

The ability to distinguish between stochastic systems based on their trajectories is crucial in thermodynamics, chemistry, and biophysics. The Kullback-Leibler (KL) divergence, $D_{\text{KL}}^{AB}(0,\tau )$, quantifies the distinguishability between the two ensembles of length-$\tau$ trajectories from Markov processes A and B. However, evaluating $D_{\text{KL}}^{AB}(0,\tau )$ from histograms of trajectories faces sufficient sampling difficulties, and no theory explicitly reveals what dynamical features contribute to the distinguishability. This letter provides a general formula that decomposes $D_{\text{KL}}^{AB}(0,\tau )$ in space and time for any Markov processes, arbitrarily far from equilibrium or steady state. It circumvents the sampling difficulty of evaluating $D_{\text{KL}}^{AB}(0,\tau )$. Furthermore, it explicitly connects trajectory KL divergence with individual transition events and their waiting time statistics. The results provide insights into understanding distinguishability between Markov processes, leading to new theoretical frameworks for designing biological sensors and optimizing signal transduction.

References in corpus (7)

• Random Walks, Markov Processes and the Multiscale Modular Organization of Complex Networks
• Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
• Fluctuation Relations for Diffusion Processes
• Response theory: a trajectory-based approach
• Averaging and large deviation principles for fully-coupled piecewise deterministic Markov processes and applications to molecular motors
• Accurate sensing of multiple ligands with a single receptor
• A Stochastic Markov Model for Coordinated Molecular Motors