Assessing enactment of content regulation policies: A post hoc crowd-sourced audit of election misinformation on YouTube

Abstract

With the 2022 US midterm elections approaching, conspiratorial claims about the 2020 presidential elections continue to threaten users' trust in the electoral process. To regulate election misinformation, YouTube introduced policies to remove such content from its searches and recommendations. In this paper, we conduct a 9-day crowd-sourced audit on YouTube to assess the extent of enactment of such policies. We recruited 99 users who installed a browser extension that enabled us to collect up-next recommendation trails and search results for 45 videos and 88 search queries about the 2020 elections. We find that YouTube's search results, irrespective of search query bias, contain more videos that oppose rather than support election misinformation. However, watching misinformative election videos still lead users to a small number of misinformative videos in the up-next trails. Our results imply that while YouTube largely seems successful in regulating election misinformation, there is still room for improvement.

22 pages

References in corpus (6)

• Towards Long-term Fairness in Recommendation
• An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changes
• Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation
• OtherTube: Facilitating Content Discovery and Reflection by Exchanging YouTube Recommendations with Strangers
• Subscriptions and external links help drive resentful users to alternative and extremist YouTube videos
• Beyond Personalization: Social Content Recommendation for Creator Equality and Consumer Satisfaction

Cited by in corpus (4)

• Viblio: Introducing Credibility Signals and Citations to Video-Sharing Platforms
• Community Fact-Checks Trigger Moral Outrage in Replies to Misleading Posts on Social Media
• Revisiting Algorithmic Audits of TikTok: Poor Reproducibility and Short-term Validity of Findings
• Algorithmic Audit of Personalisation Drift in Polarising Topics on TikTok