Scaling Laws in Human Language

Abstract

Zipf's law on word frequency is observed in English, French, Spanish, Italian, and so on, yet it does not hold for Chinese, Japanese or Korean characters. A model for writing process is proposed to explain the above difference, which takes into account the effects of finite vocabulary size. Experiments, simulations and analytical solution agree well with each other. The results show that the frequency distribution follows a power law with exponent being equal to 1, at which the corresponding Zipf's exponent diverges. Actually, the distribution obeys exponential form in the Zipf's plot. Deviating from the Heaps' law, the number of distinct words grows with the text length in three stages: It grows linearly in the beginning, then turns to a logarithmical form, and eventually saturates. This work refines previous understanding about Zipf's law and Heaps' law in language systems.

6 pages, 4 figures

References in corpus (8)

• Power-law distributions in empirical data
• Collaborative Tagging and Semiotic Dynamics
• Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
• Collective dynamics of social annotation
• Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
• Culturomics meets random fractal theory: Insights into long-range correlations of social and natural phenomena over the past two centuries
• A Yule-Simon process with memory
• Empirical analysis on a keyword-based semantic system

Cited by in corpus (15)

• Network dynamics of innovation processes
• Diversity of individual mobility patterns and emergence of aggregated scaling laws
• Computational Socioeconomics
• A complex network approach to stylometry
• Log-log Convexity of Type-Token Growth in Zipf's Systems
• Maximal Diversity and Zipf's Law
• Rank-frequency relation for Chinese characters
• Efficient learning strategy of Chinese characters based on network approach
• Dynamic Patterns of Academic Forum Activities
• Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings
• Randomness versus specifics for word-frequency distributions
• Outbreak Patterns of the Novel Avian Influenza (H7N9)
• Damping effect in innovation processes: case studies from Twitter
• Range-Limited Heaps' Law for Functional DNA Words in the Human Genome
• Quadratic Term Correction on Heaps' Law