Estimation of KL Divergence: Optimal Minimax Rate

Yuheng Bu, Shaofeng Zou, Yingbin Liang +1

The problem of estimating the Kullback-Leibler divergence $D(P\Vert Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the…