1.6k citations · 1.8k across the 18 of their papers we have counts for
Showing cs.ITShow all
2 papers · 1 filter
cs.IT2012★ 1.6k cited
Rényi Divergence and Kullback-Leibler Divergence
Tim van Erven, Peter Harremoës
Rényi divergence is related to Rényi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by Rényi as a m…
cs.IT2010★ 26 cited
Rényi Divergence and Majorization
Tim van Erven, Peter Harremoës
Rényi divergence is related to Rényi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and com…