WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning for Emotion Classification and Empathy Prediction
arXiv:2104.09827
Abstract
This paper describes our contribution to the WASSA 2021 shared task on Empathy Prediction and Emotion Classification. The broad goal of this task was to model an empathy score, a distress score and the overall level of emotion of an essay written in response to a newspaper article associated with harm to someone. We have used the ELECTRA model abundantly and also advanced deep learning approaches like multi-task learning. Additionally, we also leveraged standard machine learning techniques like ensembling. Our system achieves a Pearson Correlation Coefficient of 0.533 on sub-task I and a macro F1 score of 0.5528 on sub-task II. We ranked 1st in Emotion Classification sub-task and 3rd in Empathy Prediction sub-task
arXiv commentAccepted at WASSA-2021, 4 Pages + 1 Page (references)
References in corpus (5)
- Decoupled Weight Decay Regularization
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- Class Imbalance Problem in Data Mining Review
- Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
- Multi-task learning for natural language processing in the 2020s: where are we going?