2 papers
cs.IT2018
Determining the Number of Samples Required to Estimate Entropy in Natural Sequences
Andrew D. Back, Daniel Angus, Janet Wiles
Calculating the Shannon entropy for symbolic sequences has been widely considered in many fields. For descriptive statistical problems such as estimating the N-gram entropy of Engl…
physics.data-an2018
Fast Entropy Estimation for Natural Sequences
Andrew D. Back, Daniel Angus, Janet Wiles
It is well known that to estimate the Shannon entropy for symbolic sequences accurately requires a large number of samples. When some aspects of the data are known it is plausible…