Information gains from Monte Carlo Markov Chains

Ahmad Mehrabi, A. Ahmadi

In this paper, we present a novel method for computing the relative entropy as well as the expected relative entropy using an MCMC chain. The relative entropy from information theo…