Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking
arXiv:2011.13253
Abstract
The rapid advancement of technology in online communication via social media platforms has led to a prolific rise in the spread of misinformation and fake news. Fake news is especially rampant in the current COVID-19 pandemic, leading to people believing in false and potentially harmful claims and stories. Detecting fake news quickly can alleviate the spread of panic, chaos and potential health hazards. We developed a two stage automated pipeline for COVID-19 fake news detection using state of the art machine learning models for natural language processing. The first model leverages a novel fact checking algorithm that retrieves the most relevant facts concerning user claims about particular COVID-19 claims. The second model verifies the level of truth in the claim by computing the textual entailment between the claim and the true facts retrieved from a manually curated COVID-19 dataset. The dataset is based on a publicly available knowledge source consisting of more than 5000 COVID-19 false claims and verified explanations, a subset of which was internally annotated and cross-validated to train and evaluate our models. We evaluate a series of models based on classical text-based features to more contextual Transformer based models and observe that a model pipeline based on BERT and ALBERT for the two stages respectively yields the best results.
References in corpus (6)
- Adam: A Method for Stochastic Optimization
- Assessing the risks of "infodemics" in response to COVID-19 epidemics
- Neural Natural Language Inference Models Enhanced with External Knowledge
- A simple but tough-to-beat baseline for the Fake News Challenge stance detection task
- MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
- CORD19STS: COVID-19 Semantic Textual Similarity Dataset
Cited by in corpus (5)
- Classification Aware Neural Topic Model and its Application on a New COVID-19 Disinformation Corpus
- Hostility Detection and Covid-19 Fake News Detection in Social Media
- Exploring Content-Based and Meta-Data Analysis for Detecting Fake News Infodemic: A case study on COVID-19
- COVID-19 Fake News Detection Using Bidirectional Encoder Representations from Transformers Based Models
- Exoskeleton for the Mind: Exploring Strategies Against Misinformation with a Metacognitive Agent