A Transformer-based approach to Irony and Sarcasm detection

Abstract

Figurative Language (FL) seems ubiquitous in all social-media discussion forums and chats, posing extra challenges to sentiment analysis endeavors. Identification of FL schemas in short texts remains largely an unresolved issue in the broader field of Natural Language Processing (NLP), mainly due to their contradictory and metaphorical meaning content. The main FL expression forms are sarcasm, irony and metaphor. In the present paper we employ advanced Deep Learning (DL) methodologies to tackle the problem of identifying the aforementioned FL forms. Significantly extending our previous work [71], we propose a neural network methodology that builds on a recently proposed pre-trained transformer-based network architecture which, is further enhanced with the employment and devise of a recurrent convolutional neural network (RCNN). With this set-up, data preprocessing is kept in minimum. The performance of the devised hybrid neural architecture is tested on four benchmark datasets, and contrasted with other relevant state of the art methodologies and systems. Results demonstrate that the proposed methodology achieves state of the art performance under all benchmark datasets, outperforming, even by a large margin, all other methodologies and published studies.

arXiv commentNeural Comput & Applic (2020)

References in corpus (14)

• Efficient Estimation of Word Representations in Vector Space
• Sequence to Sequence Learning with Neural Networks
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Cross-lingual Language Model Pretraining
• Universal Sentence Encoder
• Semi-supervised Sequence Learning
• Learned in Translation: Contextualized Word Vectors
• A Large Self-Annotated Corpus for Sarcasm
• A Sentiment-and-Semantics-Based Approach for Emotion Detection in Textual Conversations
• A Survey on Sentiment and Emotion Analysis for Computational Literary Studies
• CASCADE: Contextual Sarcasm Detection in Online Discussion Forums
• A Robust Deep Ensemble Classifier for Figurative Language Detection
• Deep contextualized word representations for detecting sarcasm and irony
• "Having 2 hours to write a paper is fun!": Detecting Sarcasm in Numerical Portions of Text

Cited by in corpus (2)

• A Robust Deep Ensemble Classifier for Figurative Language Detection
• On Sarcasm Detection with OpenAI GPT-based Models