Direct Estimation of Information Divergence Using Nearest Neighbor Ratios

Morteza Noshad, Kevin R. Moon, Salimeh Yasaei Sekeh +1

We propose a direct estimation method for Rényi and f-divergence measures based on a new graph theoretical interpretation. Suppose that we are given two sample sets $X$ and $Y$, re…