First passage in discrete-time absorbing Markov chains under stochastic resetting

Abstract

First passage of stochastic processes under resetting has recently been an active research topic in the field of statistical physics. However, most of previous studies mainly focused on the systems with continuous time and space. In this paper, we study the effect of stochastic resetting on first passage properties of discrete-time absorbing Markov chains, described by a transition matrix $\brm{Q}$ between transient states and a transition matrix $\brm{R}$ from transient states to absorbing states. Using a renewal approach, we exactly derive the unconditional mean first passage time (MFPT) to either of absorbing states, the splitting probability the and conditional MFPT to each absorbing state. All the quantities can be expressed in terms of a deformed fundamental matrix $\brm{Z_γ}=\left[\brm{I}-(1-γ) \brm{Q} \right]^{-1}$ and $\brm{R}$, where $\brm{I}$ is the identity matrix, and $\gamma$ is the resetting probability at each time step. We further show a sufficient condition under which the unconditional MPFT can be optimized by stochastic resetting. Finally, we apply our results to two concrete examples: symmetric random walks on one-dimensional lattices with absorbing boundaries and voter model on complete graphs.

11 double-column pages and 5 figures

References in corpus (18)

• Statistical physics of social dynamics
• First Passage Under Restart
• Voter Models on Heterogeneous Networks
• First order transition for the optimal search time of Lévy flights with resetting
• Diffusion in a potential landscape with stochastic resetting
• Optimal mean first-passage time for a Brownian searcher subjected to resetting: experimental and theoretical results
• Diffusion with resetting in arbitrary spatial dimension
• Random walks with preferential relocations to places visited in the past and their application to biology
• Analytical Solution of the Voter Model on Disordered Networks
• Analytical results for the Sznajd model of opinion formation
• Localization transition induced by learning in random searches
• Integral Fluctuation Theorems for Stochastic Resetting Systems
• First passage under restart for discrete space and time: application to one dimensional confined lattice random walks
• Stochastic resetting on comb-like structures
• Diffusive transport on networks with stochastic resetting to multiple nodes
• Random walks on complex networks with first-passage resetting
• Drift-diffusion on a Cayley tree with stochastic resetting: the localization-delocalization transition
• Random walks on complex networks with multiple resetting nodes: a renewal approach

Cited by in corpus (3)

• Entropy rate of random walks on complex networks under stochastic resetting
• Kinetic reconstruction of free energies as a function of multiple order parameters
• Mean First Passage Time of the Symmetric Noisy Voter Model with Arbitrary Initial and Boundary Conditions