Sentiment Polarity Detection for Software Development
arXiv:1709.02984 · doi:10.1007/s10664-017-9546-9
Abstract
The role of sentiment analysis is increasingly emerging to study software developers' emotions by mining crowd-generated content within social software engineering tools. However, off-the-shelf sentiment analysis tools have been trained on non-technical domains and general-purpose social media, thus resulting in misclassifications of technical jargon and problem reports. Here, we present Senti4SD, a classifier specifically trained to support sentiment analysis in developers' communication channels. Senti4SD is trained and validated using a gold standard of Stack Overflow questions, answers, and comments manually annotated for sentiment polarity. It exploits a suite of both lexicon- and keyword-based features, as well as semantic features based on word embedding. With respect to a mainstream off-the-shelf tool, which we use as a baseline, Senti4SD reduces the misclassifications of neutral and positive posts as emotionally negative. To encourage replications, we release a lab package including the classifier, the word embedding space, and the gold standard with annotation guidelines.
arXiv commentCite as: Calefato, F., Lanubile, F., Maiorano, F., Novielli N. Empir Software Eng (2017). https://doi.org/10.1007/s10664-017-9546-9 Full-text view-only version here: http://rdcu.be/vZrG, Empir Software Eng (2017)
References in corpus (5)
- Machine Learning in Automated Text Categorization
- Mining Valence, Arousal, and Dominance - Possibilities for Detecting Burnout and Productivity?
- Recommending Insightful Comments for Source Code using Crowdsourced Knowledge
- Unhappy Developers: Bad for Themselves, Bad for Process, and Bad for Software Product
- Bootstrapping a Lexicon for Emotional Arousal in Software Engineering
Cited by in corpus (19)
- Socio-Technical Grounded Theory for Software Engineering
- A Benchmark Study on Sentiment Analysis for Software Engineering Research
- Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?
- The "Shut the f**k up" Phenomenon: Characterizing Incivility in Open Source Code Review Discussions
- Sentiment Analysis Tools in Software Engineering: A Systematic Mapping Study
- SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering
- Modern Code Reviews -- Survey of Literature and Practice
- A large-scale, in-depth analysis of developers' personalities in the Apache ecosystem
- Development and Application of Sentiment Analysis Tools in Software Engineering: A Systematic Literature Review
- On Using Machine Learning to Identify Knowledge in API Reference Documentation
- Assessment of Off-the-Shelf SE-specific Sentiment Analysis Tools: An Extended Replication Study
- On Developers' Personality in Large-scale Distributed Projects: The Case of the Apache Ecosystem
- Identifying the Mood of a Software Development Team by Analyzing Text-Based Communication in Chats with Machine Learning
- On the Use of Emoticons in Open Source Software Development
- Love, Joy, Anger, Sadness, Fear, and Surprise: SE Needs Special Kinds of AI: A Case Study on Text Mining and SE
- Nip it in the Bud: Moderation Strategies in Open Source Software Projects and the Role of Bots
- Using Personality Detection Tools for Software Engineering Research: How Far Can We Go?
- Assessing the Use of AutoML for Data-Driven Software Engineering
- On the Limitations of Combining Sentiment Analysis Tools in a Cross-Platform Setting