Assessing significance in a Markov chain without mixing

Maria Chikina, Alan Frieze, Wesley Pegden

We present a new statistical test to detect that a presented state of a reversible Markov chain was not chosen from a stationary distribution. In particular, given a value function…