SEntiMoji: An Emoji-Powered Learning Approach for Sentiment Analysis in Software Engineering

Abstract

Sentiment analysis has various application scenarios in software engineering (SE), such as detecting developers' emotions in commit messages and identifying their opinions on Q&A forums. However, commonly used out-of-the-box sentiment analysis tools cannot obtain reliable results on SE tasks and the misunderstanding of technical jargon is demonstrated to be the main reason. Then, researchers have to utilize labeled SE-related texts to customize sentiment analysis for SE tasks via a variety of algorithms. However, the scarce labeled data can cover only very limited expressions and thus cannot guarantee the analysis quality. To address such a problem, we turn to the easily available emoji usage data for help. More specifically, we employ emotional emojis as noisy labels of sentiments and propose a representation learning approach that uses both Tweets and GitHub posts containing emojis to learn sentiment-aware representations for SE-related texts. These emoji-labeled posts can not only supply the technical jargon, but also incorporate more general sentiment patterns shared across domains. They as well as labeled data are used to learn the final sentiment classifier. Compared to the existing sentiment analysis methods used in SE, the proposed approach can achieve significant improvement on representative benchmark datasets. By further contrast experiments, we find that the Tweets make a key contribution to the power of our approach. This finding informs future research not to unilaterally pursue the domain-specific resource, but try to transform knowledge from the open domain through ubiquitous signals such as emojis.

Accepted by the 2019 ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019). Please include ESEC/FSE in any citations

References in corpus (9)

• SMOTE: Synthetic Minority Over-sampling Technique
• Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm
• Sentiment Polarity Detection for Software Development
• Through a Gender Lens: Learning Usage Patterns of Emojis from Large-Scale Android Users
• Mining Valence, Arousal, and Dominance - Possibilities for Detecting Burnout and Productivity?
• A Benchmark Study on Sentiment Analysis for Software Engineering Research
• The Role of Emotions in Contributors Activity: A Case Study on the GENTOO Community
• Recommending Insightful Comments for Source Code using Crowdsourced Knowledge
• On the Use of Emoticons in Open Source Software Development

Cited by in corpus (4)

• BERT-Based Sentiment Analysis: A Software Engineering Perspective
• Revisiting Sentiment Analysis for Software Engineering in the Era of Large Language Models
• Development and Application of Sentiment Analysis Tools in Software Engineering: A Systematic Literature Review
• Assessment of Off-the-Shelf SE-specific Sentiment Analysis Tools: An Extended Replication Study