Robust estimation of a Markov chain transition matrix from multiple sample paths

Lasse Leskelä, Maximilien Dreveton

Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and…