A Trade-off-centered Framework of Content Moderation
arXiv:2206.03450 · doi:10.1145/3534929
Abstract
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it does not address how content moderation works in multiple contexts. Through a systematic literature review of 86 content moderation papers that document empirical studies, we seek to uncover patterns and tensions within past content moderation research. We find that content moderation can be characterized as a series of trade-offs around moderation actions, styles, philosophies, and values. We discuss how facilitating cooperation and preventing abuse, two key elements in Grimmelmann's definition of moderation, are inherently dialectical in practice. We close by showing how researchers, designers, and moderators can use our framework of trade-offs in their own work, and arguing that trade-offs should be of central importance in investigating and designing content moderation.
To appear in ACM TOCHI
References in corpus (4)
- Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussions
- Moderation Challenges in Voice-based Online Communities on Discord
- Content Removal as a Moderation Strategy: Compliance and Other Outcomes in the ChangeMyView Community
- "The Perfect One": Understanding Communication Practices and Challenges with Animated GIFs
Cited by in corpus (15)
- "I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.": A Study of Blind TikTokers' Content Moderation Experiences
- Hate Raids on Twitch: Understanding Real-Time Human-Bot Coordinated Attacks in Live Streaming Communities
- ARTiST: Automated Text Simplification for Task Guidance in Augmented Reality
- Content Moderation Justice and Fairness on Social Media: Comparisons Across Different Contexts and Platforms
- Nip it in the Bud: Moderation Strategies in Open Source Software Projects and the Role of Bots
- AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User Appeals
- "Ignorance is Not Bliss": Designing Personalized Moderation to Address Ableist Hate on Social Media
- The Design Space for Online Restorative Justice Tools: A Case Study with ApoloBot
- Does Positive Reinforcement Work?: A Quasi-Experimental Study of the Effects of Positive Feedback on Reddit
- Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policies
- Challenges in Restructuring Community-based Moderation
- A Civics-oriented Approach to Understanding Intersectionally Marginalized Users' Experience with Hate Speech Online
- Regulating Social Media: Surveying the Impact of Nepali Government's TikTok Ban
- Mapping Community Appeals Systems: Lessons for Community-led Moderation in Multi-Level Governance
- Measuring Centralization of Online Platforms Through Size and Interconnection of Communities