Computing expected transition events in reducible Markov chains

Brian D. Ewald, Jeffrey Humpherys, Jeremy West

We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of eve…