A class of Rényi information estimators for multidimensional densities

Nikolai Leonenko, Luc Pronzato, Vippal Savani

A class of estimators of the Rényi and Tsallis entropies of an unknown distribution $f$ in ${\mathbb{R}}^m$ is presented. These estimators are based on the $k$th nearest-neighbor dis…