Evolution of the most common English words and phrases over the centuries

Abstract

By determining which were the most common English words and phrases since the beginning of the 16th century, we obtain a unique large-scale view of the evolution of written text. We find that the most common words and phrases in any given year had a much shorter popularity lifespan in the 16th than they had in the 20th century. By measuring how their usage propagated across the years, we show that for the past two centuries the process has been governed by linear preferential attachment. Along with the steady growth of the English lexicon, this provides an empirical explanation for the ubiquity of the Zipf's law in language statistics and confirms that writing, although undoubtedly an expression of art and skill, is not immune to the same influences of self-organization that are known to regulate processes as diverse as the making of new friends and World Wide Web growth.

6 two-column pages, 4 figures; accepted for publication in Journal of the Royal Society Interface [tables available at http://www.matjazperc.com/ngrams]

References in corpus (7)

• Power-law distributions in empirical data
• Understanding individual human mobility patterns
• Statistical physics of social dynamics
• Understanding the spreading patterns of mobile phone viruses
• On Universality in Human Correspondence Activity
• Traffic-driven Epidemic Spreading in Finite-size Scale-Free Networks
• WiFi Epidemiology: Can Your Neighbors' Router Make Yours Sick?

Cited by in corpus (9)

• The Matthew effect in empirical data
• The Evolution of Popular Music: USA 1960-2010
• Languages cool as they expand: Allometric scaling and the decreasing need for new words
• Internal and external dynamics in language: Evidence from verb regularity in a historical corpus of English
• Rank diversity of languages: Generic behavior in computational linguistics
• Identifying trends in word frequency dynamics
• Language statistics at different spatial, temporal, and grammatical scales
• A minor extension of the logistic equation for growth of word counts on online media: Parametric description of diversity of growth phenomena in society
• Neutral evolution and turnover over centuries of English word popularity