From $\epsilon$-entropy to KL-entropy: Analysis of minimum information complexity density estimation

Tong Zhang

We consider an extension of $\epsilon$-entropy to a KL-divergence based complexity measure for randomized density estimation methods. Based on this extension, we develop a general informa…