Log-log Convexity of Type-Token Growth in Zipf's Systems
arXiv:1412.4577 · doi:10.1103/PhysRevLett.114.238701
Abstract
It is traditionally assumed that Zipf's law implies the power-law growth of the number of different elements with the total number of elements in a system - the so-called Heaps' law. We show that a careful definition of Zipf's law leads to the violation of Heaps' law in random systems, and obtain alternative growth curves. These curves fulfill universal data collapses that only depend on the value of the Zipf's exponent. We observe that real books behave very much in the same way as random systems, despite the presence of burstiness in word occurrence. We advance an explanation for this unexpected correspondence.
References in corpus (18)
- Power-law distributions in empirical data
- Power laws, Pareto distributions and Zipf's law
- Zipf's Law in Gene Expression
- Measuring the evolution of contemporary western popular music
- Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
- Languages cool as they expand: Allometric scaling and the decreasing need for new words
- Gibrat's law for cities: uniformly most powerful unbiased test of the Pareto against the lognormal
- Stochastic model for the vocabulary growth in natural languages
- Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
- Understanding scaling through history-dependent processes with collapsing sample space
- Zipf's law for word frequencies: word forms versus lemmas in long texts
- Scaling laws and fluctuations in the statistics of word frequencies
- Scaling Laws in Human Language
- A scaling law beyond Zipf's law and its relation to Heaps' law
- Statistical Patterns in Written Language
- Theory of Zipf's Law and of General Power Law Distributions with Gibrat's law of Proportional Growth
- A practical recipe to fit discrete power-law distributions
- A Paradoxical Property of the Monkey Book
Cited by in corpus (14)
- Large-scale analysis of Zipf's law in English texts
- Linguistic laws in biology
- The origins of Zipf's meaning-frequency law
- Polysemy and brevity versus frequency in language
- Zipf and Heaps laws from dependency structures in component systems
- The brevity law as a scaling law, and a possible origin of Zipf's law for word frequencies
- Statistics of shared components in complex component systems
- On the emergence of Zipf's law in music
- Heaps' law, statistics of shared components and temporal patterns from a sample-space-reducing process
- The meaning-frequency law in Zipfian optimization models of communication
- Heaps' Law and Vocabulary Richness in the History of Classical Music Harmony
- Corrections of Zipf's and Heaps' Laws Derived from Hapax Rate Models
- Range-Limited Heaps' Law for Functional DNA Words in the Human Genome
- Quadratic Term Correction on Heaps' Law