A Precisely Xtreme-Multi Channel Hybrid Approach For Roman Urdu Sentiment Analysis
arXiv:2003.05443
Abstract
In order to accelerate the performance of various Natural Language Processing tasks for Roman Urdu, this paper for the very first time provides 3 neural word embeddings prepared using most widely used approaches namely Word2vec, FastText, and Glove. The integrity of generated neural word embeddings is evaluated using intrinsic and extrinsic evaluation approaches. Considering the lack of publicly available benchmark datasets, it provides a first-ever Roman Urdu dataset which consists of 3241 sentiments annotated against positive, negative and neutral classes. To provide benchmark baseline performance over the presented dataset, we adapt diverse machine learning (Support Vector Machine Logistic Regression, Naive Bayes), deep learning (convolutional neural network, recurrent neural network), and hybrid approaches. Effectiveness of generated neural word embeddings is evaluated by comparing the performance of machine and deep learning based methodologies using 7, and 5 distinct feature representation approaches respectively. Finally, it proposes a novel precisely extreme multi-channel hybrid methodology which outperforms state-of-the-art adapted machine and deep learning approaches by the figure of 9%, and 4% in terms of F1-score. Roman Urdu Sentiment Analysis, Pretrain word embeddings for Roman Urdu, Word2Vec, Glove, Fast-Text
References in corpus (14)
- Distributed Representations of Words and Phrases and their Compositionality
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Comparative Study of CNN and RNN for Natural Language Processing
- An Analysis of Hierarchical Text Classification Using Word Embeddings
- Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches
- Training of Deep Neural Networks based on Distance Measures using RMSProp
- Using text analysis to quantify the similarity and evolution of scientific disciplines
- Learning text representation using recurrent convolutional neural network with highway layers
- Word Embeddings: A Survey
- Sentiment Classification of Customer Reviews about Automobiles in Roman Urdu
- Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
- Multi-label Classification of User Reactions in Online News
- Exploring Different Dimensions of Attention for Uncertainty Detection
- Character n-gram Embeddings to Improve RNN Language Models