Bayesian analysis for reversible Markov chains
arXiv:math/0605582 · doi:10.1214/009053606000000290
Abstract
We introduce a natural conjugate prior for the transition matrix of a reversible Markov chain. This allows estimation and testing. The prior arises from random walk with reinforcement in the same way the Dirichlet prior arises from Pólya's urn. We give closed form normalizing constants, a simple method of simulation from the posterior and a characterization along the lines of W. E. Johnson's characterization of the Dirichlet prior.
Published at http://dx.doi.org/10.1214/009053606000000290 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
Cited by in corpus (6)
- A survey of random processes with reinforcement
- An asymptotic result for Brownian polymers
- On the transience of processes defined on Galton--Watson trees
- Linearly edge-reinforced random walks
- Edge-reinforced random walk on a ladder
- Algebraic Bayesian analysis of contingency tables with possibly zero-probability cells