Waiting times and stopping probabilities for patterns in Markov chains

Min-Zhi Zhao, Dong Xu, Hui-Zeng Zhang

Suppose that $\mathcal{C}$ is a finite collection of patterns. Observe a Markov chain until one of the patterns in $\mathcal{C}$ occurs as a run. This time is denoted by $\tau$. In this…