Diffusion of Context and Credit Information in Markovian Models

Y. Bengio, P. Frasconi

This paper studies the problem of ergodicity of transition probability matrices in Markovian models, such as hidden Markov models (HMMs), and how it makes very difficult the task o…