Emergence of Zipf's Law in the Evolution of Communication
arXiv:1008.0938 · doi:10.1103/PhysRevE.83.036115
Abstract
Zipf's law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and hearer in a communication system, we introduce evolution by means of a variational approach to the problem based on Kullback's Minimum Discrimination of Information Principle. Therefore, using a formalism fully embedded in the framework of information theory, we demonstrate that Zipf's law is the only expected outcome of an evolving, communicative system under a rigorous definition of the communicative tension described by Zipf.
7 pages, 2 figures
References in corpus (2)
Cited by in corpus (20)
- Stochastic model for the vocabulary growth in natural languages
- Large-scale analysis of Zipf's law in English texts
- Understanding scaling through history-dependent processes with collapsing sample space
- Statistical laws in linguistics
- Dynamics of ranking
- A scaling law beyond Zipf's law and its relation to Heaps' law
- Authorship recognition via fluctuation analysis of network topology and word intermittency
- Optimization models of natural communication
- Rank diversity of languages: Generic behavior in computational linguistics
- Sample space reducing cascading processes produce the full spectrum of scaling exponents
- Rank-frequency relation for Chinese characters
- Explaining Zipf's Law via Mental Lexicon
- Rank dynamics of word usage at multiple scales
- On the origin of ambiguity in efficient communication
- Zipf's law arises naturally in structured, high-dimensional data
- Analysis of an information-theoretic model for communication
- Multifractal analysis of sentence lengths in English literary texts
- Non-random structures in universal compression and the Fermi paradox
- Language statistics at different spatial, temporal, and grammatical scales
- Understanding Zipf's law of word frequencies through sample-space collapse in sentence formation