Generalized inverses of Markovian kernels in terms of properties of the Markov chain

Abstract

All one-condition generalized inverses of the Markovian kernel I - P, where P is the transition matrix of a finite irreducible Markov chain, can be uniquely specified in terms of the stationary probabilities and the mean first passage times of the underlying Markov chain. Special sub-families include the group inverse of I - P, Kemeny and Snell's fundamental matrix of the Markov chain and the Moore-Penrose g-inverse. The elements of some sub-families of the generalized inverses can also be re-expressed involving the second moments of the recurrence time variables. Some applications to Kemeny's constant and perturbations of Markov chains are also considered.

21 pages

Cited by in corpus (9)

• The Computation of the Mean First Passage Times for Markov Chains
• Duality for open fermion systems: energy-dependent weak coupling and quantum master equations
• The Computation of Key Properties of Markov Chains via Perturbations
• Asymptotic Expansions for Stationary Distributions of Perturbed Semi-Markov Processes
• A Generalized Fundamental Matrix for Computing Fundamental Quantities of Markov Systems
• Fast Algorithm for Relaxation Processes in Big-data Systems
• The generalized Alice HH vs Bob HT problem
• On the Kemeny time for continuous-time reversible and irreversible Markov processes with applications to stochastic resetting and to conditioning towards forever-survival
• Geometrical structures of the instantaneous current and their macroscopic effects: vortices and perspectives in non-gradient models