Supervised Contrastive Learning for Multimodal Unreliable News Detection in COVID-19 Pandemic
arXiv:2109.01850 · doi:10.1145/3459637.3482196
Abstract
As the digital news industry becomes the main channel of information dissemination, the adverse impact of fake news is explosively magnified. The credibility of a news report should not be considered in isolation. Rather, previously published news articles on the similar event could be used to assess the credibility of a news report. Inspired by this, we propose a BERT-based multimodal unreliable news detection framework, which captures both textual and visual information from unreliable articles utilising the contrastive learning strategy. The contrastive learner interacts with the unreliable news classifier to push similar credible news (or similar unreliable news) closer while moving news articles with similar content but opposite credibility labels away from each other in the multimodal embedding space. Experimental results on a COVID-19 related dataset, ReCOVery, show that our model outperforms a number of competitive baseline in unreliable news detection.
arXiv commentAccepted by the CIKM 2021
References in corpus (6)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
- Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge
- A Survey on Natural Language Processing for Fake News Detection
- FANG: Leveraging Social Context for Fake News Detection Using Graph Representation
- ReCOVery: A Multimodal Repository for COVID-19 News Credibility Research