Entropy Estimates from Insufficient Samplings

P. Grassberger

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M…