First passage in discrete-time absorbing Markov chains under stochastic resetting

Abstract

First passage of stochastic processes under resetting has recently been an active research topic in the field of statistical physics. However, most of previous studies mainly focused on the systems with continuous time and space. In this paper, we study the effect of stochastic resetting on first passage properties of discrete-time absorbing Markov chains, described by a transition matrix $\brm{Q}$ between transient states and a transition matrix $\brm{R}$ from transient states to absorbing states. Using a renewal approach, we exactly derive the unconditional mean first passage time (MFPT) to either of absorbing states, the splitting probability the and conditional MFPT to each absorbing state. All the quantities can be expressed in terms of a deformed fundamental matrix $\brm{Z_γ}=\left[\brm{I}-(1-γ) \brm{Q} \right]^{-1}$ and $\brm{R}$, where $\brm{I}$ is the identity matrix, and $\gamma$ is the resetting probability at each time step. We further show a sufficient condition under which the unconditional MPFT can be optimized by stochastic resetting. Finally, we apply our results to two concrete examples: symmetric random walks on one-dimensional lattices with absorbing boundaries and voter model on complete graphs.

arXiv comment11 double-column pages and 5 figures

References in corpus (58)

• Statistical physics of social dynamics
• Epidemic processes in complex networks
• Diffusion with Stochastic Resetting
• Voter Model on Heterogeneous Graphs
• Stochastic Resetting and Applications
• Persistence and First-Passage Properties in Non-equilibrium Systems
• Diffusion with Optimal Resetting
• First Passage Under Restart
• Voter Models on Heterogeneous Networks
• First order transition for the optimal search time of Lévy flights with resetting
• Optimal stochastic restart renders fluctuations in first passage times universal
• Experimental realization of diffusion with stochastic resetting
• Diffusion under time-dependent resetting
• Run and tumble particle under resetting: a renewal approach
• Diffusion in a potential landscape with stochastic resetting
• Optimal mean first-passage time for a Brownian searcher subjected to resetting: experimental and theoretical results
• Diffusion with resetting in arbitrary spatial dimension
• Random walks with preferential relocations to places visited in the past and their application to biology
• Analytical Solution of the Voter Model on Disordered Networks
• Analytical results for the Sznajd model of opinion formation
• Fluctuating interfaces subject to stochastic resetting
• First passage under stochastic resetting in an interval
• The Michaelis-Menten reaction scheme as a unified approach towards the optimal restart problem
• Optimal first arrival times in Lévy flights with resetting
• Boosting search by rare events
• Stochastic thermodynamics of resetting
• Large deviations for Markov processes with resetting
• Resetting processes with non-instanteneous return
• Effects of refractory period on stochastic resetting
• First passage of a particle in a potential under stochastic resetting: a vanishing transition of optimal resetting rate
• Work fluctuations and Jarzynski equality in stochastic resetting
• Péclet number governs transition to acceleratory restart in drift-diffusion
• Optimization in First-Passage Resetting
• Landau theory of restart transitions
• Random walks on networks with stochastic resetting
• Integral Fluctuation Theorems for Stochastic Resetting Systems
• Random walk with random resetting to the maximum
• Localization transition induced by learning in random searches
• Symmetric Exclusion Process under Stochastic Resetting
• Phase transitions in optimal search times: how random walkers should combine resetting and flight scales
• Path-integral formalism for stochastic resetting: Exactly solved examples and shortcuts to confinement
• Stochastic resetting with stochastic returns using external trap
• Ising model with stochastic resetting
• Run-and-Tumble particles in Two-dimensions under Stochastic Resetting
• First passage under restart for discrete space and time: application to one dimensional confined lattice random walks
• Active Brownian Motion in two-dimensions under Stochastic Resetting
• Invariants of motion with stochastic resetting and space-time coupled returns
• Sisyphus random walk
• Mean first passage time of active Brownian particle in one dimension
• Stochastic resetting on comb-like structures
• Diffusion with Resetting Inside a Circle
• Diffusive transport on networks with stochastic resetting to multiple nodes
• Anderson-like localization transition of random walks with resetting
• Random walks on complex networks with first-passage resetting
• From classical to quantum walks with stochastic resetting on networks
• Optimization and Growth in First-Passage Resetting
• Drift-diffusion on a Cayley tree with stochastic resetting: the localization-delocalization transition
• Random walks on complex networks with multiple resetting nodes: a renewal approach

Cited by in corpus (3)

• Entropy rate of random walks on complex networks under stochastic resetting
• Kinetic reconstruction of free energies as a function of multiple order parameters
• Mean First Passage Time of the Symmetric Noisy Voter Model with Arbitrary Initial and Boundary Conditions