SENECA: Small-Sample Discrete Entropy Estimation via Self-Consistent Missing Mass

Lucas H. McCabe, H. Howie Huang

Discrete entropy estimation is a classic information theory problem, wherein the average information content of a discrete random variable is estimated from samples alone. Naive ap…