A Generalization of Relative Entropy to Count Vectors and its Concentration Property

Kostas N. Oikonomou

We introduce a new generalization of relative entropy to non-negative vectors with sums $>1$. We show in a purely combinatorial setting, with no probabilistic considerations, th…