Diffusion of Lexical Change in Social Media

Abstract

Computer-mediated communication is driving fundamental changes in the nature of written language. We investigate these changes by statistical analysis of a dataset comprising 107 million Twitter messages (authored by 2.7 million unique user accounts). Using a latent vector autoregressive model to aggregate across thousands of words, we identify high-level patterns in diffusion of linguistic change over the United States. Our model is robust to unpredictable changes in Twitter's sampling rate, and provides a probabilistic characterization of the relationship of macro-scale linguistic influence to a set of demographic and geographic predictors. The results of this analysis offer support for prior arguments that focus on geographical proximity and population size. However, demographic similarity -- especially with regard to race -- plays an even more central role, as cities with similar racial demographics are far more likely to share linguistic influence. Rather than moving towards a single unified "netspeak" dialect, language evolution in computer-mediated communication reproduces existing fault lines in spoken American English.

preprint of PLOS-ONE paper from November 2014; PLoS ONE 9(11) e113114

References in corpus (5)

• Power-law distributions in empirical data
• Validation of Dunbar's number in Twitter conversations
• The Geography of Happiness: Connecting Twitter sentiment and expression, demographics, and objective characteristics of place
• Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
• Cascading Behavior in Large Blog Graphs

Cited by in corpus (36)

• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• Mapping the Americanization of English in Space and Time
• Computational Socioeconomics
• Analyzing the Language of Food on Social Media
• Survey of Computational Approaches to Lexical Semantic Change
• How we do things with words: Analyzing text as social and cultural data
• Dialectometric analysis of language variation in Twitter
• Socioeconomic Dependencies of Linguistic Patterns in Twitter: A Multivariate Analysis
• American cultural regions mapped through the lexical analysis of social media
• Global Syntactic Variation in Seven Languages: Towards a Computational Dialectology
• Predicting language diversity with complex network
• Twitter as a Source of Global Mobility Patterns for Social Good
• Semantic Variation in Online Communities of Practice
• The Road to Success: Assessing the Fate of Linguistic Innovations in Online Communities
• ASSED -- A Framework for Identifying Physical Events through Adaptive Social Sensor Data Filtering
• Hahahahaha, Duuuuude, Yeeessss!: A two-parameter characterization of stretchable words and the dynamics of mistypings and misspellings
• Representations of Language Varieties Are Reliable Given Corpus Similarity Measures
• Entropy and type-token ratio in gigaword corpora
• When Dialects Collide: How Socioeconomic Mixing Affects Language Use
• Mapping Languages and Demographics with Georeferenced Corpora
• A Kernel Independence Test for Geographical Language Variation
• Characterizing English Variation across Social Media Communities with BERT
• EDNA-Covid: A Large-Scale Covid-19 Tweets Dataset Collected with the EDNA Streaming Toolkit
• Finding Your Voice: The Linguistic Development of Mental Health Counselors
• Emo, Love, and God: Making Sense of Urban Dictionary, a Crowd-Sourced Online Dictionary
• Computational Sociolinguistics: A Survey
• Modeling Global Syntactic Variation in English Using Dialect Classification
• Concept Drift Detection and Adaptation with Weak Supervision on Streaming Unlabeled Data
• Quantification and Analysis of Scientific Language Variation Across Research Fields
• Using Sociolinguistic Variables to Reveal Changing Attitudes Towards Sexuality and Gender
• Challenges and Opportunities in Rapid Epidemic Information Propagation with Live Knowledge Aggregation from Social Media
• DialectGram: Detecting Dialectal Variation at Multiple Geographic Resolutions
• Concept Drift Adaptive Physical Event Detection for Social Media Streams
• Event Detection in Noisy Streaming Data with Combination of Corroborative and Probabilistic Sources
• EventMapper: Detecting Real-World Physical Events Using Corroborative and Probabilistic Sources
• Exploiting user-frequency information for mining regionalisms from Social Media texts