Bayesian estimation of information-theoretic metrics for sparsely sampled distributions

Angelo Piga, Lluc Font-Pomarol, Marta Sales-Pardo +1

Estimating the Shannon entropy of a discrete distribution from which we have only observed a small sample is challenging. Estimating other information-theoretic metrics, such as th…