Investigating the heterogenous effects of a massive content moderation intervention via Difference-in-Differences
arXiv:2411.04037 · doi:10.1016/j.osnem.2025.100320
Abstract
In today's online environments, users encounter harm and abuse on a daily basis. Therefore, content moderation is crucial to ensure their safety and well-being. However, the effectiveness of many moderation interventions is still uncertain. Here, we apply a causal inference approach to shed light on the effectiveness of The Great Ban, a massive social media deplatforming intervention on Reddit. We analyze 53M comments shared by nearly 34K users, providing in-depth results on both the intended and unintended consequences of the ban. Our causal analyses reveal that 15.6% of the moderated users abandoned the platform while the remaining ones decreased their overall toxicity by 4.1%. Nonetheless, a small subset of users exhibited marked increases in both the intensity and volume of toxic behavior, particularly among those whose activity levels changed after the intervention. However, these reactions were not accompanied by greater activity or engagement, suggesting that even the most toxic users maintained a limited overall impact. Our findings bring to light new insights on the effectiveness of deplatforming moderation interventions. Furthermore, they also contribute to informing future content moderation strategies and regulations.
arXiv commentarXiv admin note: text overlap with arXiv:2401.11254 This work is an extension of this conference paper: Cima, L., Trujillo, A., Avvenuti, M., & Cresci, S. (2024, May). The Great Ban: Efficacy and Unintended Consequences of a Massive Deplatforming Operation on Reddit. In Companion Publication of the 16th ACM Web Science Conference (pp. 85-93)
References in corpus (8)
- BERTopic: Neural topic modeling with a class-based TF-IDF procedure
- Factuality Challenges in the Era of Large Language Models
- OpenAssistant Conversations -- Democratizing Large Language Model Alignment
- Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels
- The Systemic Impact of Deplatforming on Social Media
- The Aftermath of Disbanding an Online Hateful Community
- The Great Ban: Efficacy and Unintended Consequences of a Massive Deplatforming Operation on Reddit
- Beyond Trial-and-Error: Predicting User Abandonment After a Moderation Intervention