Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning

Abstract

Irrespective of the success of the deep learning-based mixed-domain transfer learning approach for solving various Natural Language Processing tasks, it does not lend a generalizable solution for detecting misinformation from COVID-19 social media data. Due to the inherent complexity of this type of data, caused by its dynamic (context evolves rapidly), nuanced (misinformation types are often ambiguous), and diverse (skewed, fine-grained, and overlapping categories) nature, it is imperative for an effective model to capture both the local and global context of the target domain. By conducting a systematic investigation, we show that: (i) the deep Transformer-based pre-trained models, utilized via the mixed-domain transfer learning, are only good at capturing the local context, thus exhibits poor generalization, and (ii) a combination of shallow network-based domain-specific models and convolutional neural networks can efficiently extract local as well as global context directly from the target data in a hierarchical fashion, enabling it to offer a more generalizable solution.

arXiv commentThe 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP)

References in corpus (9)

• Efficient Estimation of Word Representations in Vector Space
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Sequence to Sequence Learning with Neural Networks
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
• The science of fake news
• Pre-trained Models for Natural Language Processing: A Survey
• ktrain: A Low-Code Library for Augmented Machine Learning
• A Study of the Generalizability of Self-Supervised Representations
• Covid-19 infodemic reveals new tipping point epidemiology and a revised $R$ formula