Demystifying Fixed k-Nearest Neighbor Information Estimators

Weihao Gao, Sewoong Oh, Pramod Viswanath

Estimating mutual information from i.i.d. samples drawn from an unknown joint density function is a basic statistical problem of broad interest with multitudinous applications. The…