"Ignorance is Not Bliss": Designing Personalized Moderation to Address Ableist Hate on Social Media
arXiv:2503.21844 · doi:10.1145/3706598.3713997
Abstract
Disabled people on social media often experience ableist hate and microaggressions. Prior work has shown that platform moderation often fails to remove ableist hate leaving disabled users exposed to harmful content. This paper examines how personalized moderation can safeguard users from viewing ableist comments. During interviews and focus groups with 23 disabled social media users, we presented design probes to elicit perceptions on configuring their filters of ableist speech (e.g. intensity of ableism and types of ableism) and customizing the presentation of the ableist speech to mitigate the harm (e.g. AI rephrasing the comment and content warnings). We found that participants preferred configuring their filters through types of ableist speech and favored content warnings. We surface participants distrust in AI-based moderation, skepticism in AI's accuracy, and varied tolerances in viewing ableist hate. Finally we share design recommendations to support users' agency, mitigate harm from hate, and promote safety.
References in corpus (12)
- A Framework of Severity for Harmful Content Online
- Trauma-Informed Social Media: Towards Solutions for Reducing and Healing Online Harm
- "HOT" ChatGPT: The promise of ChatGPT in detecting and discriminating hateful, offensive, and toxic comments on social media
- A Trade-off-centered Framework of Content Moderation
- Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Labor
- Designing Word Filter Tools for Creator-led Comment Moderation
- Online Harassment in Majority Contexts: Examining Harms and Remedies across Countries
- The Virality of Hate Speech on Social Media
- Personalized Interventions for Online Moderation
- "Because Some Sighted People, They Don't Know What the Heck You're Talking About:" A Study of Blind TikTokers' Infrastructuring Work to Build Independence
- The Monetisation of Toxicity: Analysing YouTube Content Creators and Controversy-Driven Engagement
- Automated Ableism: An Exploration of Explicit Disability Biases in Sentiment and Toxicity Analysis Models