16 citations · 16 across the 2 of their papers we have counts for
3 papers · 1 filter
Optimal coding and the origins of Zipfian laws
Ramon Ferrer-i-Cancho, Christian Bentz, Caio Seguin
The problem of compression in standard information theory consists of assigning codes as short as possible to numbers. Here we consider the problem of optimal coding -- under an ar…
Fast calculation of entropy with Zhang's estimator
Antoni Lozano, Bernardino Casas, Chris Bentz +1
Entropy is a fundamental property of a repertoire. Here, we present an efficient algorithm to estimate the entropy of types with the help of Zhang's estimator. The algorithm takes…
The word entropy of natural languages
Christian Bentz, Dimitrios Alikaniotis
The average uncertainty associated with words is an information-theoretic concept at the heart of quantitative and computational linguistics. The entropy has been established as a…