Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Labor

Abstract

Social media platforms moderate content for each user by incorporating the outputs of both platform-wide content moderation systems and, in some cases, user-configured personal moderation preferences. However, it is unclear (1) how end users perceive the choices and affordances of different kinds of personal content moderation tools, and (2) how the introduction of personalization impacts user perceptions of platforms' content moderation responsibilities. This paper investigates end users' perspectives on personal content moderation tools by conducting an interview study with a diverse sample of 24 active social media users. We probe interviewees' preferences using simulated personal moderation interfaces, including word filters, sliders for toxicity levels, and boolean toxicity toggles. We also examine the labor involved for users in choosing moderation settings and present users' attitudes about the roles and responsibilities of social media platforms and other stakeholders towards moderation. We discuss how our findings can inform design solutions to improve transparency and controllability in personal content moderation tools.

Will appear in ACM CSCW

References in corpus (1)

• Designing Word Filter Tools for Creator-led Comment Moderation

Cited by in corpus (10)

• Form-From: A Design Space of Social Media Systems
• Mapping the Design Space of Teachable Social Media Feed Experiences
• The Great Ban: Efficacy and Unintended Consequences of a Massive Deplatforming Operation on Reddit
• "Ignorance is Not Bliss": Designing Personalized Moderation to Address Ableist Hate on Social Media
• Social Media for Activists: Reimagining Safety, Content Presentation, and Workflows
• DanModCap: Designing a Danmaku Moderation Tool for Video-Sharing Platforms that Leverages Impact Captions with Large Language Models
• End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Prompting
• Behind the Counter: Exploring the Motivations and Barriers of Online Counterspeech Writing
• Steering AI-Driven Personalization of Scientific Text for General Audiences
• Understanding the Perceptions of Trigger Warning and Content Warning on Social Media Platforms in the U.S