On the Theory and Algorithm for rigorous discretization in applications of Information Theory

Venkateshan Kannan, Jesper Tegnèr

We identify fundamental issues with discretization when estimating information-theoretic quantities in the analysis of data. These difficulties are theoretical in nature and arise…