The meta book and size-dependent properties of written language
arXiv:0909.4385 · doi:10.1088/1367-2630/11/12/123015
Abstract
Evidence is given for a systematic text-length dependence of the power-law index gamma of a single book. The estimated gamma values are consistent with a monotonic decrease from 2 to 1 with increasing length of a text. A direct connection to an extended Heap's law is explored. The infinite book limit is, as a consequence, proposed to be given by gamma = 1 instead of the value gamma=2 expected if the Zipf's law was ubiquitously applicable. In addition we explore the idea that the systematic text-length dependence can be described by a meta book concept, which is an abstract representation reflecting the word-frequency structure of a text. According to this concept the word-frequency distribution of a text, with a certain length written by a single author, has the same characteristics as a text of the same length pulled out from an imaginary complete infinite corpus written by the same author.
7 pages, 6 figures, 1 table
References in corpus (5)
Cited by in corpus (24)
- The Matthew effect in empirical data
- Languages cool as they expand: Allometric scaling and the decreasing need for new words
- Stochastic model for the vocabulary growth in natural languages
- Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death
- Zipf's law unzipped
- Scaling laws and fluctuations in the statistics of word frequencies
- Scaling Laws in Human Language
- A scaling law beyond Zipf's law and its relation to Heaps' law
- Comparing intermittency and network measurements of words and their dependency on authorship
- Allometric Scaling of Countries
- Truncated lognormal distributions and scaling in the size of naturally defined population clusters
- Rank-frequency relation for Chinese characters
- Size dependent word frequencies and translational invariance of books
- Application of a Quantum Ensemble Model to Linguistic Analysis
- Structural preferential attachment: Stochastic process for the growth of scale-free, modular and self-similar systems
- A Paradoxical Property of the Monkey Book
- The Ten Thousand Kims
- Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings
- Randomness versus specifics for word-frequency distributions
- The Dependence of Frequency Distributions on Multiple Meanings of Words, Codes and Signs
- Size-Dependency of Income Distributions and Its Implications
- Range-Limited Heaps' Law for Functional DNA Words in the Human Genome
- Complete asymptotic type-token relationship for growing complex systems with inverse power-law count rankings
- Quadratic Term Correction on Heaps' Law