Bias Analysis in Entropy Estimation

Thomas Schürmann

We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed ana…