Minimax Rate-Optimal Estimation of Divergences between Discrete Distributions

Yanjun Han, Jiantao Jiao, Tsachy Weissman

We study the minimax estimation of $\alpha$-divergences between discrete distributions for integer $\alpha \ge 1$, which include the Kullback--Leibler divergence and the ${\chi }^2$-divergences as…