Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death

Abstract

We analyze the dynamic properties of 10^7 words recorded in English, Spanish and Hebrew over the period 1800--2008 in order to gain insight into the coevolution of language and culture. We report language independent patterns useful as benchmarks for theoretical models of language evolution. A significantly decreasing (increasing) trend in the birth (death) rate of words indicates a recent shift in the selection laws governing word use. For new words, we observe a peak in the growth-rate fluctuations around 40 years after introduction, consistent with the typical entry time into standard dictionaries and the human generational timescale. Pronounced changes in the dynamics of language during periods of war shows that word correlations, occurring across time and between words, are largely influenced by coevolutionary social, technological, and political factors. We quantify cultural memory by analyzing the long-term correlations in the use of individual words using detrended fluctuation analysis.

Version 1: 31 pages, 17 figures, 3 tables. Version 2 is streamlined, eliminates substantial material and incorporates referee comments: 19 pages, 14 figures, 3 tables

References in corpus (11)

• Robust dynamic classes revealed by measuring the response function of a social system
• Cultural route to the emergence of linguistic categories
• Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
• Persistence and Uncertainty in the Academic Career
• In-depth analysis of the Naming Game dynamics: the homogeneous mixing case
• The Size Variance Relationship of Business Firm Growth Rates
• Culturomics meets random fractal theory: Insights into long-range correlations of social and natural phenomena over the past two centuries
• Niche as a determinant of word fate in online groups
• Empirical analysis of collective human behavior for extraordinary events in blogosphere
• The blogosphere as an excitable social medium: Richter's and Omori's Law in media coverage
• Universal Complex Structures in Written Language

Cited by in corpus (29)

• Characterizing the Google Books corpus: Strong limits to inferences of socio-cultural and linguistic evolution
• Languages cool as they expand: Allometric scaling and the decreasing need for new words
• Distance to the scaling law: a useful approach for unveiling relationships between crime and urban metrics
• Stochastic model for the vocabulary growth in natural languages
• Evolution of the most common English words and phrases over the centuries
• Internal and external dynamics in language: Evidence from verb regularity in a historical corpus of English
• A Triple Helix Model of Medical Innovation: Supply, Demand, and Technological Capabilities in terms of Medical Subject Headings
• Sample and population exponents of generalized Taylor's law
• Generalized Word Shift Graphs: A Method for Visualizing and Explaining Pairwise Comparisons Between Texts
• Probing the statistical properties of unknown texts: application to the Voynich Manuscript
• Scaling Laws in Human Language
• Universality of citation distributions for academic institutions and journals
• Quantitative analysis of the evolution of novelty in cinema through crowdsourced keywords
• Rank diversity of languages: Generic behavior in computational linguistics
• Stochastic dynamics of lexicon learning in an uncertain and nonuniform world
• Efficient learning strategy of Chinese characters based on network approach
• Rank dynamics of word usage at multiple scales
• Identifying trends in word frequency dynamics
• Invariant features of spatial inequality in consumption: the case of India
• Empirical observations of ultraslow diffusion driven by the fractional dynamics in languages: Dynamical statistical properties of word counts of already popular words
• Socio-economic inequalities: a statistical physics perspective
• Scaling symmetry, renormalization, and time series modeling
• Modeling competitive evolution of multiple languages
• Characterizing the public perception of WhatsApp through the lens of media
• Information-theoretical analysis of the statistical dependencies among three variables: Applications to written language
• Communicative need modulates competition in language change
• Subdiffusive semantic evolution in Indo-European languages
• Neutral evolution and turnover over centuries of English word popularity
• Fake news as we feel it: perception and conceptualization of the term "fake news" in the media