Scalable and Generalizable Social Bot Detection through Data Selection
arXiv:1911.09179 · doi:10.1609/aaai.v34i01.5460
Abstract
Efficient and reliable social bot classification is crucial for detecting information manipulation on social media. Despite rapid development, state-of-the-art bot detection models still face generalization and scalability challenges, which greatly limit their applications. In this paper we propose a framework that uses minimal account metadata, enabling efficient analysis that scales up to handle the full stream of public tweets of Twitter in real time. To ensure model accuracy, we build a rich collection of labeled datasets for training and validation. We deploy a strict validation system so that model performance on unseen datasets is also optimized, in addition to traditional cross-validation. We find that strategically selecting a subset of training data yields better model accuracy and generalization than exhaustively training on all available data. Thanks to the simplicity of the proposed model, its logic can be interpreted to provide insights into social bot characteristics.
arXiv commentAAAI 2020
References in corpus (17)
- Scikit-learn: Machine Learning in Python
- BotOrNot: A System to Evaluate Social Bots
- Consistent Individualized Feature Attribution for Tree Ensembles
- Deep Neural Networks for Bot Detection
- Bots increase exposure to negative and inflammatory content in online social systems
- Disinformation and Social Bot Operations in the Run Up to the 2017 French Presidential Election
- The DARPA Twitter Bot Challenge
- Arming the public with artificial intelligence to counter social bots
- Online Human-Bot Interactions: Detection, Estimation, and Characterization
- DNA-inspired online behavioral modeling and its application to spambot detection
- Social Fingerprinting: detection of spambot groups through DNA-inspired behavioral modeling
- Its All in a Name: Detecting and Labeling Bots by Their Name
- An Unsupervised Approach to Detect Spam Campaigns that Use Botnets on Twitter
- RTbust: Exploiting Temporal Patterns for Botnet Detection on Twitter
- Bot Electioneering Volume: Visualizing Social Bot Activity During Elections
- LOBO -- Evaluation of Generalization Deficiencies in Twitter Bot Classifiers
- Perils and Challenges of Social Media and Election Manipulation Analysis: The 2018 US Midterms
Cited by in corpus (36)
- A Decade of Social Bot Detection
- TwiBot-20: A Comprehensive Twitter Bot Detection Benchmark
- Botometer 101: Social bot practicum for computational social scientists
- Detection of Novel Social Bots by Ensembles of Specialized Classifiers
- BotRGCN: Twitter Bot Detection with Relational Graph Convolutional Networks
- Studying Fake News Spreading, Polarisation Dynamics, and Manipulation by Bots: a Tale of Networks and Language
- Exposure to Social Engagement Metrics Increases Vulnerability to Misinformation
- SATAR: A Self-supervised Approach to Twitter Account Representation Learning and its Application in Bot Detection
- Unsupervised Social Bot Detection via Structural Information Theory
- One Year of COVID-19 Vaccine Misinformation on Twitter: Longitudinal Study
- Right and left, partisanship predicts (asymmetric) vulnerability to misinformation
- RoSGAS: Adaptive Social Bot Detection with Reinforced Self-Supervised GNN Architecture Search
- Anatomy of an AI-powered malicious social botnet
- Artificial Intelligence for Social Good: A Survey
- Political audience diversity and news reliability in algorithmic ranking
- Bots, Disinformation, and the First Trump Impeachment
- FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection
- Simplistic Collection and Labeling Practices Limit the Utility of Benchmark Datasets for Twitter Bot Detection
- BotShape: A Novel Social Bots Detection Approach via Behavioral Patterns
- On the efficacy of old features for the detection of new bots
- Identification of Twitter Bots Based on an Explainable Machine Learning Framework: The US 2020 Elections Case Study
- Multimodal Detection of Bots on X (Twitter) using Transformers
- AI-Generated Faces in the Real World: A Large-Scale Case Study of Twitter Profile Images
- Social Bots and Social Media Manipulation in 2020: The Year in Review
- A Graph Neural Architecture Search Approach for Identifying Bots in Social Media
- The Anatomy of Conspirators: Unveiling Traits using a Comprehensive Twitter Dataset
- The COVID-19 Infodemic: Twitter versus Facebook
- Adoption of Twitter's New Length Limit: Is 280 the New 140?
- Synthetic Politics: Prevalence, Spreaders, and Emotional Reception of AI-Generated Political Images on X
- Birdspotter: A Tool for Analyzing and Labeling Twitter Users
- Anticipated versus Actual Effects of Platform Design Change: A Case Study of Twitter's Character Limit
- Analyzing Activity and Suspension Patterns of Twitter Bots Attacking Turkish Twitter Trends by a Longitudinal Dataset
- People Still Care About Facts: Twitter Users Engage More with Factual Discourse than Misinformation--A Comparison Between COVID and General Narratives on Twitter
- Bot-Match: Social Bot Detection with Recursive Nearest Neighbors Search
- BOTTER: A framework to analyze social bots in Twitter
- A comparative study of Bot Detection techniques methods with an application related to Covid-19 discourse on Twitter