209 citations · 211 across the 2 of their papers we have counts for
5 papers
Bounds on the Information Divergence for Hypergeometric Distributions
Peter Harremoës, František Matúš
The hypergeometric distributions have many important applications, but they have not had sufficient attention in information theory. Hypergeometric distributions can be approximate…
Statistical Inference and Exact Saddle Point Approximations
Peter Harremoës
Statistical inference may follow a frequentist approach or it may follow a Bayesian approach or it may use the minimum description length principle (MDL). Our goal is to identify s…
Is Zero a Natural Number?
Peter Harremoës
It is argued that zero should be considered as a cardinal number but not an ordinal number. One should make a clear distinction between order types that are labels for well-ordered…
Properties of Classical and Quantum Jensen-Shannon Divergence
Jop Briët, Peter Harremoës
Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback div…
Interpretations of Renyi Entropies And Divergences
Peter Harremoes
In this paper a new operational definition of Renyi entropy and Renyi divergence is presented. Other operational definitions are mentioned.