Zipf's Law and Avoidance of Excessive Synonymy

Abstract

Zipf's law states that if words of language are ranked in the order of decreasing frequency in texts, the frequency of a word is inversely proportional to its rank. It is very robust as an experimental observation, but to date it escaped satisfactory theoretical explanation. We suggest that Zipf's law may arise from the evolution of word semantics dominated by expansion of meanings and competition of synonyms.

47 pages; fixed reference list missing in v.1

Cited by in corpus (11)

• Zipf's law in 50 languages: its structural pattern, linguistic interpretation, and cognitive motivation
• Information content versus word length in random typing
• Complexity vs Energy: Theory of Computation and Theoretical Physics
• Excess entropy in natural language: present state and perspectives
• Rank-frequency relation for Chinese characters
• Explaining Zipf's Law via Mental Lexicon
• Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings
• Two halves of a meaningful text are statistically different
• Zipf's law and L. Levin's probability distributions
• Neural codes and homotopy types: mathematical models of place field recognition
• Non-random structures in universal compression and the Fermi paradox