Chernoff-type Concentration of Empirical Probabilities in Relative Entropy

F. Richard Guo, Thomas S. Richardson

We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by s…