Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM

Abstract

Sentiment analysis on large-scale social media data is important to bridge the gaps between social media contents and real world activities including political election prediction, individual and public emotional status monitoring and analysis, and so on. Although textual sentiment analysis has been well studied based on platforms such as Twitter and Instagram, analysis of the role of extensive emoji uses in sentiment analysis remains light. In this paper, we propose a novel scheme for Twitter sentiment analysis with extra attention on emojis. We first learn bi-sense emoji embeddings under positive and negative sentimental tweets individually, and then train a sentiment classifier by attending on these bi-sense emoji embeddings with an attention-based long short-term memory network (LSTM). Our experiments show that the bi-sense embedding is effective for extracting sentiment-aware embeddings of emojis and outperforms the state-of-the-art models. We also visualize the attentions to show that the bi-sense emoji embedding provides better guidance on the attention mechanism to obtain a more robust understanding of the semantics and sentiments.

References in corpus (7)

• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• Thumbs up? Sentiment Classification using Machine Learning Techniques
• Sentiment of Emojis
• Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm
• Emoticons vs. Emojis on Twitter: A Causal Inference Approach
• Spice up Your Chat: The Intentions and Sentiment Effects of Using Emoji

Cited by in corpus (10)

• Fast Parallel Hypertree Decompositions in Logarithmic Recursion Depth
• Over a Decade of Social Opinion Mining: A Systematic Review
• PDANet: Polarity-consistent Deep Attention Network for Fine-grained Visual Emotion Regression
• Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attention
• A Novel Sentiment Analysis Engine for Preliminary Depression Status Estimation on Social Media
• Understanding the Teaching Styles by an Attention based Multi-task Cross-media Dimensional modelling
• A First Look at Emoji Usage on GitHub: An Empirical Study
• Stock Price Prediction Under Anomalous Circumstances
• A `Sourceful' Twist: Emoji Prediction Based on Sentiment, Hashtags and Application Source
• FeelsGoodMan: Inferring Semantics of Twitch Neologisms