Non-asymptotic Estimates for Markov Transition Matrices via Spectral Gap Methods

De Huang, Xiangyuan Li

We establish non-asymptotic error bounds for the classical Maximal Likelihood Estimation of the transition matrix of a given Markov chain. Meanwhile, in the reversible case, we pro…