Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media
arXiv:1704.01347 · doi:10.1145/2998181.2998321
Abstract
Search systems in online social media sites are frequently used to find information about ongoing events and people. For topics with multiple competing perspectives, such as political events or political candidates, bias in the top ranked results significantly shapes public opinion. However, bias does not emerge from an algorithm alone. It is important to distinguish between the bias that arises from the data that serves as the input to the ranking system and the bias that arises from the ranking system itself. In this paper, we propose a framework to quantify these distinct biases and apply this framework to politics-related queries on Twitter. We found that both the input data and the ranking system contribute significantly to produce varying amounts of bias in the search results and in different ways. We discuss the consequences of these biases and possible mechanisms to signal this bias in social media search systems' interfaces.
In Proceedings of ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW), Portland, USA, February 2017
Cited by in corpus (16)
- The COVID-19 Social Media Infodemic
- FA*IR: A Fair Top-k Ranking Algorithm
- Discrimination through optimization: How Facebook's ad delivery can lead to skewed outcomes
- Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors
- Facebook Ads Monitor: An Independent Auditing System for Political Ads on Facebook
- Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers
- Cruising Queer HCI on the DL: A Literature Review of LGBTQ+ People in HCI
- Evaluation Metrics for Measuring Bias in Search Engine Results
- White, Man, and Highly Followed: Gender and Race Inequalities in Twitter
- Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation
- Biases in the Facebook News Feed: a Case Study on the Italian Elections
- Assessing enactment of content regulation policies: A post hoc crowd-sourced audit of election misinformation on YouTube
- Search engine effects on news consumption: ranking and representativeness outweigh familiarity in news selection
- Cognitively Biased Users Interacting with Algorithmically Biased Results in Whole-Session Search on Debated Topics
- Discerning media bias within a network of political allies and opponents: the idealized example of a biased coin
- Algorithmic Fairness Datasets: the Story so Far