Languages cool as they expand: Allometric scaling and the decreasing need for new words
arXiv:1212.2616 · doi:10.1038/srep00943
Abstract
We analyze the occurrence frequencies of over 15 million words recorded in millions of books published during the past two centuries in seven different languages. For all languages and chronological subsets of the data we confirm that two scaling regimes characterize the word frequency distributions, with only the more common words obeying the classic Zipf law. Using corpora of unprecedented size, we test the allometric scaling relation between the corpus size and the vocabulary size of growing languages to demonstrate a decreasing marginal need for new words, a feature that is likely related to the underlying correlations between words. We calculate the annual growth fluctuations of word use which has a decreasing trend as the corpus size increases, indicating a slowdown in linguistic evolution following language expansion. This "cooling pattern" forms the basis of a third statistical regularity, which unlike the Zipf and the Heaps law, is dynamical in nature.
arXiv comment9 two-column pages, 7 figures; accepted for publication in Scientific Reports
References in corpus (21)
- Power-law distributions in empirical data
- Power laws, Pareto distributions and Zipf's law
- Laws of Population Growth
- Global Organization of the Lexicon
- Modeling Urban Growth Patterns with Correlated Percolation
- Power Law Scaling for a System of Interacting Units with Complex Internal Structure
- The Growth of Business Firms: Theoretical Framework and Empirical Evidence
- Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
- Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
- Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death
- On the origin of long-range correlations in texts
- Zipf's law unzipped
- Notes on the occupancy problem with infinitely many boxes: general asymptotics and power laws
- Evolution of the most common English words and phrases over the centuries
- Culturomics meets random fractal theory: Insights into long-range correlations of social and natural phenomena over the past two centuries
- The Size Variance Relationship of Business Firm Growth Rates
- Niche as a determinant of word fate in online groups
- How to Create an Innovation Accelerator
- The meta book and size-dependent properties of written language
- Network model of human language
- Size dependent word frequencies and translational invariance of books
Cited by in corpus (48)
- Characterizing the Google Books corpus: Strong limits to inferences of socio-cultural and linguistic evolution
- Networks in Cognitive Science
- Stochastic model for the vocabulary growth in natural languages
- Mapping the Americanization of English in Space and Time
- Large-scale analysis of Zipf's law in English texts
- Computational Socioeconomics
- Internal and external dynamics in language: Evidence from verb regularity in a historical corpus of English
- A Triple Helix Model of Medical Innovation: Supply, Demand, and Technological Capabilities in terms of Medical Subject Headings
- Statistical laws in linguistics
- Zipf's law for word frequencies: word forms versus lemmas in long texts
- Probing the statistical properties of unknown texts: application to the Voynich Manuscript
- A scaling law beyond Zipf's law and its relation to Heaps' law
- Optimization models of natural communication
- The distinct flavors of Zipf's law in the rank-size and in the size-distribution representations, and its maximum-likelihood fitting
- Fractal Dimensions Derived from Spatial Allometric Scaling of Urban Form
- Log-log Convexity of Type-Token Growth in Zipf's Systems
- Text mixing shapes the anatomy of rank-frequency distributions: A modern Zipfian mechanics for natural language
- Modeling the average shortest path length in growth of word-adjacency networks
- Generalized Entropies and the Similarity of Texts
- Spatial evolution of human dialects
- Statistics of shared components in complex component systems
- Efficient learning strategy of Chinese characters based on network approach
- Topological properties and organizing principles of semantic networks
- Rank dynamics of word usage at multiple scales
- Simon's fundamental rich-get-richer model entails a dominant first-mover advantage
- Memory and long-range correlations in chess games
- The Natural Selection of Words: Finding the Features of Fitness
- Long Short-Term Memory Networks for CSI300 Volatility Prediction with Baidu Search Volume
- Predicting language diversity with complex network
- Lognormals, Power Laws and Double Power Laws in the Distribution of Frequencies of Harmonic Codewords from Classical Music
- Long-Range Correlations and Memory in the Dynamics of Internet Interdomain Routing
- Linguistic evolution driven by network heterogeneity and the Turing mechanism
- Modelling of temporal fluctuation scaling in online news network with independent cascade model
- Language competition in a population of migrating agents
- Rank-frequency distribution of natural languages: a difference of probabilities approach
- Randomness versus specifics for word-frequency distributions
- The infochemical core
- Evolution of biomedical innovation quantified via billions of distinct article-level MeSH keyword combinations
- Entropy and type-token ratio in gigaword corpora
- Statistical Physics of Language Maps in the USA
- Two halves of a meaningful text are statistically different
- Damping effect in innovation processes: case studies from Twitter
- Phase transitions in a decentralized graph-based approach to human language
- Corrections of Zipf's and Heaps' Laws Derived from Hapax Rate Models
- Range-Limited Heaps' Law for Functional DNA Words in the Human Genome
- A minor extension of the logistic equation for growth of word counts on online media: Parametric description of diversity of growth phenomena in society
- Zipf's laws of meaning in Catalan
- Oscillatory dynamics between language usage and economic activity