Crowdsourcing Dialect Characterization through Twitter

Abstract

We perform a large-scale analysis of language diatopic variation using geotagged microblogging datasets. By collecting all Twitter messages written in Spanish over more than two years, we build a corpus from which a carefully selected list of concepts allows us to characterize Spanish varieties on a global scale. A cluster analysis proves the existence of well defined macroregions sharing common lexical properties. Remarkably enough, we find that Spanish language is split into two superdialects, namely, an urban speech used across major American and Spanish citites and a diverse form that encompasses rural areas and small towns. The latter can be further clustered into smaller varieties with a stronger regional character.

10 pages, 5 figures

References in corpus (3)

• Assessing Vaccination Sentiments with Online Social Media: Implications for Infectious Disease Dynamics and Control
• The Twitter of Babel: Mapping World Languages through Microblogging Platforms
• Structural and Dynamical Patterns on Online Social Networks: the Spanish May 15th Movement as a case study

Cited by in corpus (17)

• Mapping the Americanization of English in Space and Time
• Comparing and modeling land use organization in cities
• Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives
• Immigrant community integration in world cities
• Dialectometric analysis of language variation in Twitter
• American cultural regions mapped through the lexical analysis of social media
• Capturing the diversity of multilingual societies
• Topical differences between Chinese language Twitter and Sina Weibo
• Freshman or Fresher? Quantifying the Geographic Variation of Internet Language
• Domain Adaptation for Named Entity Recognition in Online Media with Word Embeddings
• Hahahahaha, Duuuuude, Yeeessss!: A two-parameter characterization of stretchable words and the dynamics of mistypings and misspellings
• Entropy and type-token ratio in gigaword corpora
• Modeling language ideologies for the dynamics of languages in contact
• When Dialects Collide: How Socioeconomic Mixing Affects Language Use
• Language dynamics within adaptive networks: An agent-based approach of nodes and links coevolution
• Exploiting user-frequency information for mining regionalisms from Social Media texts
• Using Sociolinguistic Variables to Reveal Changing Attitudes Towards Sexuality and Gender