Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
arXiv:1002.3861 · doi:10.1371/journal.pone.0014139
Abstract
Background: Zipf's law and Heaps' law are observed in disparate complex systems. Of particular interests, these two laws often appear together. Many theoretical models and analyses are performed to understand their co-occurrence in real systems, but it still lacks a clear picture about their relation. Methodology/Principal Findings: We show that the Heaps' law can be considered as a derivative phenomenon if the system obeys the Zipf's law. Furthermore, we refine the known approximate solution of the Heaps' exponent provided the Zipf's exponent. We show that the approximate solution is indeed an asymptotic solution for infinite systems, while in the finite-size system the Heaps' exponent is sensitive to the system size. Extensive empirical analysis on tens of disparate systems demonstrates that our refined results can better capture the relation between the Zipf's and Heaps' exponents. Conclusions/Significance: The present analysis provides a clear picture about the relation between the Zipf's law and Heaps' law without the help of any specific stochastic model, namely the Heaps' law is indeed a derivative phenomenon from Zipf's law. The presented numerical method gives considerably better estimation of the Heaps' exponent given the Zipf's exponent and the system size. Our analysis provides some insights and implications of real complex systems, for example, one can naturally obtained a better explanation of the accelerated growth of scale-free networks.
15 pages, 6 figures, 1 Table
References in corpus (27)
- Emergence of scaling in random networks
- Statistical mechanics of complex networks
- The structure and function of complex networks
- Epidemic spreading in scale-free networks
- Power laws, Pareto distributions and Zipf's law
- How Popular is Your Paper? An Empirical Study of the Citation Distribution
- Scale-free topology of e-mail networks
- Problems with Fitting to the Power-Law Distribution
- Exponential and power-law probability distributions of wealth and income in the United Kingdom and the United States
- Highly Optimized Tolerance: Robustness and Power Laws in Complex Systems
- Information diffusion epidemics in social networks
- Collaborative Tagging and Semiotic Dynamics
- Impact of non-Poisson activity patterns on spreading processes
- Zipf's Law in Gene Expression
- Interacting Individuals Leading to Zipf's Law
- Effect of the accelerating growth of communications networks on their structure
- Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
- Role of Activity in Human Dynamics
- Entropy and Long range correlations in literary English
- Entropy and Long range correlations in literary English
- Collective dynamics of social annotation
- Human Activity in the Web
- Zipf law in the popularity distribution of chess openings
- Family name distributions: Master equation approach
- Empirical analysis on a keyword-based semantic system
- Accelerating networks
- Scaling in the global spreading patterns of pandemic Influenza A (H1N1) and the role of control: empirical statistics and modeling
Cited by in corpus (49)
- Languages cool as they expand: Allometric scaling and the decreasing need for new words
- Tag-Aware Recommender Systems: A State-of-the-art Survey
- Computational Socioeconomics
- Dynamics on expanding spaces: modeling the emergence of novelties
- Geography and similarity of regional cuisines in China
- Evolution of scaling emergence in large-scale spatial epidemic spreading
- Statistical laws in linguistics
- Scaling laws and fluctuations in the statistics of word frequencies
- Zipf's, Heaps' and Taylor's laws are determined by the expansion into the adjacent possible
- Scaling Laws in Human Language
- A scaling law beyond Zipf's law and its relation to Heaps' law
- Dynamical approach to Zipf's law
- Complex systems approach to natural language
- The Mathematical Relationship between Zipf's Law and the Hierarchical Scaling Law
- Taylor's law in innovation processes
- Long-run dynamics of the U.S. patent classification system
- The distinct flavors of Zipf's law in the rank-size and in the size-distribution representations, and its maximum-likelihood fitting
- Log-log Convexity of Type-Token Growth in Zipf's Systems
- Zipf and Heaps laws from dependency structures in component systems
- Complexity measurement of natural and artificial languages
- Zipf's law, 1/f noise, and fractal hierarchy
- Statistical Patterns in Written Language
- Empirical studies on the network of social groups: the case of Tencent QQ
- Statistics of shared components in complex component systems
- Maximal Diversity and Zipf's Law
- Quantitative Comparison of Abundance Structures of Generalized Communities: From B-Cell Receptor Repertoires to Microbiomes
- Efficient learning strategy of Chinese characters based on network approach
- Rank-frequency relation for Chinese characters
- Accelerating Growth and Size-dependent Distribution of Human Activities Online
- On the emergence of Zipf's law in music
- Innovation and Nested Preferential Growth in Chess Playing Behavior
- A comparative analysis of knowledge acquisition performance in complex networks
- Do Neural Nets Learn Statistical Laws behind Natural Language?
- Heaps' law, statistics of shared components and temporal patterns from a sample-space-reducing process
- Dynamic Patterns of Academic Forum Activities
- The Accelerating Growth of Online Tagging Systems
- Evolution of popularity in given names
- Approximation of LRU Caches Miss Rate: Application to Power-law Popularities
- Randomness versus specifics for word-frequency distributions
- Outbreak Patterns of the Novel Avian Influenza (H7N9)
- Size-Dependency of Income Distributions and Its Implications
- Damping effect in innovation processes: case studies from Twitter
- Scaling in the global spreading patterns of pandemic Influenza A (H1N1) and the role of control: empirical statistics and modeling
- Recovering Zipf's law in intercontinental scientific collaboration
- Distinct Degrees and Their Distribution in Complex Networks
- Time-Dependent Urn Models reproduce the full spectrum of novelties discovery
- Evaluating Computational Language Models with Scaling Properties of Natural Language
- Neutral evolution and turnover over centuries of English word popularity
- Complete asymptotic type-token relationship for growing complex systems with inverse power-law count rankings