Social Turing Tests: Crowdsourcing Sybil Detection

Abstract

As popular tools for spreading spam and malware, Sybils (or fake accounts) pose a serious threat to online communities such as Online Social Networks (OSNs). Today, sophisticated attackers are creating realistic Sybils that effectively befriend legitimate users, rendering most automated Sybil detection techniques ineffective. In this paper, we explore the feasibility of a crowdsourced Sybil detection system for OSNs. We conduct a large user study on the ability of humans to detect today's Sybil accounts, using a large corpus of ground-truth Sybil accounts from the Facebook and Renren networks. We analyze detection accuracy by both "experts" and "turkers" under a variety of conditions, and find that while turkers vary significantly in their effectiveness, experts consistently produce near-optimal results. We use these results to drive the design of a multi-tier crowdsourcing Sybil detection system. Using our user study data, we show that this system is scalable, and can be highly effective either as a standalone system or as a complementary technique to current tools.

References in corpus (1)

• Uncovering Social Network Sybils in the Wild

Cited by in corpus (20)

• Deep Neural Networks for Bot Detection
• Arming the public with artificial intelligence to counter social bots
• The paradigm-shift of social spambots: Evidence, theories, and tools for the arms race
• SybilBelief: A Semi-supervised Learning Approach for Structure-based Sybil Detection
• Measuring social spam and the effect of bots on information diffusion in social media
• SybilFrame: A Defense-in-Depth Framework for Structure-Based Sybil Detection
• Security Threats and Research Challenges of IoT-A Review
• Defending against Sybil Devices in Crowdsourced Mapping Services
• Twitter Bot Detection Using Bidirectional Long Short-term Memory Neural Networks and Word Embeddings
• Human-Misinformation interaction: Understanding the interdisciplinary approach needed to computationally combat false information
• Systems Applications of Social Networks
• A Network Topology Approach to Bot Classification
• Smoke Screener or Straight Shooter: Detecting Elite Sybil Attacks in User-Review Social Networks
• Are Deep Learning-Generated Social Media Profiles Indistinguishable from Real Profiles?
• Combating Disinformation in a Social Media Age
• Behavioral Modeling of Persian Instagram Users to detect Bots
• A network centrality method for the rating problem
• Investigating Coordinated 'Social' Targeting of High-Profile Twitter Accounts
• Fake News Detection in Social Networks via Crowd Signals
• A Socio-Informatic Approach to Automated Account Classification on Social Media