A Benchmark Study of Machine Learning Models for Online Fake News Detection
arXiv:1905.04749 · doi:10.1016/j.mlwa.2021.100032
Abstract
The proliferation of fake news and its propagation on social media has become a major concern due to its ability to create devastating impacts. Different machine learning approaches have been suggested to detect fake news. However, most of those focused on a specific type of news (such as political) which leads us to the question of dataset-bias of the models used. In this research, we conducted a benchmark study to assess the performance of different applicable machine learning approaches on three different datasets where we accumulated the largest and most diversified one. We explored a number of advanced pre-trained language models for fake news detection along with the traditional and deep learning ones and compared their performances from different aspects for the first time to the best of our knowledge. We find that BERT and similar pre-trained models perform the best for fake news detection, especially with very small dataset. Hence, these models are significantly better option for languages with limited electronic contents, i.e., training data. We also carried out several analysis based on the models' performance, article's topic, article's length, and discussed different lessons learned from them. We believe that this benchmark study will help the research community to explore further and news sites/blogs to select the most appropriate fake news detection method.
arXiv comment22 pages, 5 figures, to be published in Machine Learning with Applications journal
References in corpus (19)
- Distilling the Knowledge in a Neural Network
- Decoupled Weight Decay Regularization
- Convolutional Neural Networks for Sentence Classification
- CSI: A Hybrid Deep Model for Fake News Detection
- AraBERT: Transformer-based Model for Arabic Language Understanding
- A C-LSTM Neural Network for Text Classification
- Fake News Detection on Social Media: A Data Mining Perspective
- Deep Learning Based Text Classification: A Comprehensive Review
- Empath: Understanding Topic Signals in Large-Scale Text
- A Survey on Natural Language Processing for Fake News Detection
- BERTje: A Dutch BERT Model
- DocBERT: BERT for Document Classification
- 3HAN: A Deep Neural Network for Fake News Detection
- Some Like it Hoax: Automated Fake News Detection in Social Networks
- How to Fine-Tune BERT for Text Classification?
- Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets
- BERT Rediscovers the Classical NLP Pipeline
- Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
- Ginger Cannot Cure Cancer: Battling Fake Health News with a Comprehensive Data Repository
Cited by in corpus (5)
- MisRoBÆRTa: Transformers versus Misinformation
- MCWDST: a Minimum-Cost Weighted Directed Spanning Tree Algorithm for Real-Time Fake News Mitigation in Social Media
- Graph-based Modeling of Online Communities for Fake News Detection
- Mutual Hyperlinking Among Misinformation Peddlers
- Tackling Fake News in Bengali: Unraveling the Impact of Summarization vs. Augmentation on Pre-trained Language Models