Benchmarking sentiment analysis methods for large-scale texts: A case for using continuum-scored words and word shift graphs
arXiv:1512.00531
Abstract
The emergence and global adoption of social media has rendered possible the real-time estimation of population-scale sentiment, bearing profound implications for our understanding of human behavior. Given the growing assortment of sentiment measuring instruments, comparisons between them are evidently required. Here, we perform detailed tests of 6 dictionary-based methods applied to 4 different corpora, and briefly examine a further 20 methods. We show that a dictionary-based method will only perform both reliably and meaningfully if (1) the dictionary covers a sufficiently large enough portion of a given text's lexicon when weighted by word usage frequency; and (2) words are scored on a continuous scale.
arXiv comment45 pages, 34 figures. More dictionaries added
References in corpus (6)
- Twitter mood predicts the stock market
- Temporal patterns of happiness and information in a global social network: Hedonometrics and Twitter
- A new ANEW: Evaluation of a word list for sentiment analysis in microblogs
- The Geography of Happiness: Connecting Twitter sentiment and expression, demographics, and objective characteristics of place
- Characterizing the Google Books corpus: Strong limits to inferences of socio-cultural and linguistic evolution
- Reply to Garcia et al.: Common mistakes in measuring frequency dependent word characteristics