Leveraging Deep Graph-Based Text Representation for Sentiment Polarity Applications

Abstract

Over the last few years, machine learning over graph structures has manifested a significant enhancement in text mining applications such as event detection, opinion mining, and news recommendation. One of the primary challenges in this regard is structuring a graph that encodes and encompasses the features of textual data for the effective machine learning algorithm. Besides, exploration and exploiting of semantic relations is regarded as a principal step in text mining applications. However, most of the traditional text mining methods perform somewhat poor in terms of employing such relations. In this paper, we propose a sentence-level graph-based text representation which includes stop words to consider semantic and term relations. Then, we employ a representation learning approach on the combined graphs of sentences to extract the latent and continuous features of the documents. Eventually, the learned features of the documents are fed into a deep neural network for the sentiment classification task. The experimental results demonstrate that the proposed method substantially outperforms the related sentiment analysis approaches based on several benchmark datasets. Furthermore, our method can be generalized on different datasets without any dependency on pre-trained word embeddings.

arXiv comment33 pages, 6 figures, 6 Tables, Accepted for publication in Expert Systems With Applications Journal

References in corpus (13)

• Scikit-learn: Machine Learning in Python
• Efficient Estimation of Word Representations in Vector Space
• Deep Learning in Neural Networks: An Overview
• DeepWalk: Online Learning of Social Representations
• Twitter mood predicts the stock market
• Natural Language Processing (almost) from Scratch
• LINE: Large-scale Information Network Embedding
• Convolutional Neural Networks for Sentence Classification
• Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain's Ventral Visual Pathway
• CNN Features off-the-shelf: an Astounding Baseline for Recognition
• A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts
• Memory Enriched Big Bang Big Crunch Optimization Algorithm for Data Clustering
• Relevant based structure learning for feature selection

Cited by in corpus (3)

• ParsBERT: Transformer-based Model for Persian Language Understanding
• A Framework for Pre-processing of Social Media Feeds based on Integrated Local Knowledge Base
• Automatic Expansion of Domain-Specific Affective Models for Web Intelligence Applications