Fairness of Exposure in Rankings

Abstract

Rankings are ubiquitous in the online world today. As we have transitioned from finding books in libraries to ranking products, jobs, job applicants, opinions and potential romantic partners, there is a substantial precedent that ranking systems have a responsibility not only to their users but also to the items being ranked. To address these often conflicting responsibilities, we propose a conceptual and computational framework that allows the formulation of fairness constraints on rankings in terms of exposure allocation. As part of this framework, we develop efficient algorithms for finding rankings that maximize the utility for the user while provably satisfying a specifiable notion of fairness. Since fairness goals can be application specific, we show how a broad range of fairness constraints can be implemented using our framework, including forms of demographic parity, disparate treatment, and disparate impact constraints. We illustrate the effect of these constraints by providing empirical results on two ranking problems.

In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, London, UK, 2018

References in corpus (10)

• Equality of Opportunity in Supervised Learning
• Counterfactual Fairness
• Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
• FA*IR: A Fair Top-k Ranking Algorithm
• Equity of Attention: Amortizing Individual Fairness in Rankings
• Avoiding Discrimination through Causal Reasoning
• Learning Non-Discriminatory Predictors
• Designing Fair Ranking Schemes
• Recommendations as Treatments: Debiasing Learning and Evaluation
• On the relation between accuracy and fairness in binary classification

Cited by in corpus (147)

• Fairness in Machine Learning: A Survey
• A Survey on the Fairness of Recommender Systems
• Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search
• Equity of Attention: Amortizing Individual Fairness in Rankings
• Beyond Personalization: Research Directions in Multistakeholder Recommendation
• User-oriented Fairness in Recommendation
• Controlling Fairness and Bias in Dynamic Learning-to-Rank
• Towards Long-term Fairness in Recommendation
• Evaluating Stochastic Rankings with Expected Exposure
• AutoDebias: Learning to Debias for Recommendation
• Deconfounded Recommendation for Alleviating Bias Amplification
• Personalized Counterfactual Fairness in Recommendation
• Connecting User and Item Perspectives in Popularity Debiasing for Collaborative Recommendation
• FairSight: Visual Analytics for Fairness in Decision Making
• Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities
• Building Human Values into Recommender Systems: An Interdisciplinary Synthesis
• Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems
• Fairness in Ranking: A Survey
• Towards Intersectionality in Machine Learning: Including More Identities, Handling Underrepresentation, and Performing Evaluation
• Toward Pareto Efficient Fairness-Utility Trade-off inRecommendation through Reinforcement Learning
• A Graph-based Approach for Mitigating Multi-sided Exposure Bias in Recommender Systems
• A Stakeholder-Centered View on Fairness in Music Recommender Systems
• Interplay between Upsampling and Regularization for Provider Fairness in Recommender Systems
• Explainable Fairness in Recommendation
• Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers
• Fairness for Robust Log Loss Classification
• Policy Learning for Fairness in Ranking
• Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud
• Towards Fair Recommendation in Two-Sided Platforms
• Inequality and Inequity in Network-based Ranking and Recommendation Algorithms
• Maximizing Marginal Fairness for Dynamic Learning to Rank
• Policy-Gradient Training of Fair and Unbiased Ranking Functions
• Towards Individual and Multistakeholder Fairness in Tourism Recommender Systems
• The Fairness of Risk Scores Beyond Classification: Bipartite Ranking and the xAUC Metric
• What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective
• Assessing Viewpoint Diversity in Search Results Using Ranking Fairness Metrics
• Fair Ranking as Fair Division: Impact-Based Individual Fairness in Ranking
• Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rank
• Unbiased Cascade Bandits: Mitigating Exposure Bias in Online Learning to Rank Recommendation
• Measuring Recommender System Effects with Simulated Users
• Fairness of Exposure in Light of Incomplete Exposure Estimation
• Understanding and Mitigating the Effect of Outliers in Fair Ranking
• Achieving Fairness in the Stochastic Multi-armed Bandit Problem
• Overcoming Failures of Imagination in AI Infused System Development and Deployment
• Intersectional Two-sided Fairness in Recommendation
• RGRecSys: A Toolkit for Robustness Evaluation of Recommender Systems
• Fairness-Aware Explainable Recommendation over Knowledge Graphs
• Fairness Through Robustness: Investigating Robustness Disparity in Deep Learning
• Evaluating Fairness in Argument Retrieval
• FAIR: Fairness-Aware Information Retrieval Evaluation
• Learning Fair Scoring Functions: Bipartite Ranking under ROC-based Fairness Constraints
• Are We Really Achieving Better Beyond-Accuracy Performance in Next Basket Recommendation?
• Reducing Disparate Exposure in Ranking: A Learning To Rank Approach
• Introducing the Expohedron for Efficient Pareto-optimal Fairness-Utility Amortizations in Repeated Rankings
• Cognitively Biased Users Interacting with Algorithmically Biased Results in Whole-Session Search on Debated Topics
• Happiness Maximizing Sets under Group Fairness Constraints (Technical Report)
• Accounting for Model Uncertainty in Algorithmic Discrimination
• Loss-Aversively Fair Classification
• FairSearch: A Tool For Fairness in Ranked Search Results
• Do Offline Metrics Predict Online Performance in Recommender Systems?
• Top-Personalized-K Recommendation
• Doubly Calibrated Estimator for Recommendation on Data Missing Not At Random
• Subverting Fair Image Search with Generative Adversarial Perturbations
• Recommending With, Not For: Co-Designing Recommender Systems for Social Good
• Curse of "Low" Dimensionality in Recommender Systems
• Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Ranking
• Deontological Ethics By Monotonicity Shape Constraints
• Characterizing Intersectional Group Fairness with Worst-Case Comparisons
• Fairness of Exposure in Stochastic Bandits
• RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystems
• The Role of Relevance in Fair Ranking
• Truncated Log-concave Sampling with Reflective Hamiltonian Monte Carlo
• Overview of the TREC 2020 Fair Ranking Track
• Predictive Uncertainty-based Bias Mitigation in Ranking
• Regulating Group Exposure for Item Providers in Recommendation
• Marginal-Certainty-aware Fair Ranking Algorithm
• Vertical Allocation-based Fair Exposure Amortizing in Ranking
• Properties of Group Fairness Metrics for Rankings
• On the Impact of Outlier Bias on User Clicks
• Bandit Algorithms for Precision Medicine
• Non-submodular Function Maximization subject to a Matroid Constraint, with Applications
• Technical Challenges for Training Fair Neural Networks
• Recent Advances in the Foundations and Applications of Unbiased Learning to Rank
• Group fairness without demographics using social networks
• Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning
• Overview of the TREC 2019 Fair Ranking Track
• A Ranking Approach to Fair Classification
• Pareto-Optimal Fairness-Utility Amortizations in Rankings with a DBN Exposure Model
• A Framework for Fairness in Two-Sided Marketplaces
• Driving the Herd: Search Engines as Content Influencers
• Group Fairness in Bandit Arm Selection
• Comparing Fair Ranking Metrics
• Consequential Ranking Algorithms and Long-term Welfare
• Scalable and Provably Fair Exposure Control for Large-Scale Recommender Systems
• Automatic Feature Fairness in Recommendation via Adversaries
• Intersectional Affirmative Action Policies for Top-k Candidates Selection
• FARA: Future-aware Ranking Algorithm for Fairness Optimization
• Quantifying the Impact of User Attention on Fair Group Representation in Ranked Lists
• Recommendation Fairness: From Static to Dynamic
• FairMILE: Towards an Efficient Framework for Fair Graph Representation Learning
• An Adaptive Boosting Technique to Mitigate Popularity Bias in Recommender System
• Stairway to Fairness: Connecting Group and Individual Fairness
• A Conceptual Framework for Evaluating Fairness in Search
• Pairwise Fairness for Ranking and Regression
• Fairness in Ranking under Disparate Uncertainty
• What is fair? Exploring the artists' perspective on the fairness of music streaming platforms
• Investigating Societal Biases in a Poetry Composition System
• Individually Fair Ranking
• Fairness Through Regularization for Learning to Rank
• Language Fairness in Multilingual Information Retrieval
• RAGUEL: Recourse-Aware Group Unfairness Elimination
• hyperFA*IR: A hypergeometric approach to fair rankings with finite candidate pool
• A Pre-processing Method for Fairness in Ranking
• Fairness in Ranking under Uncertainty
• Towards Content Provider Aware Recommender Systems: A Simulation Study on the Interplay between User and Provider Utilities
• A Primal-Dual Subgradient Approachfor Fair Meta Learning
• Calibrating Explore-Exploit Trade-off for Fair Online Learning to Rank
• Auditing the Sensitivity of Graph-based Ranking with Visual Analytics
• Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking Fairness and Algorithm Utility
• Fairness-Aware Online Personalization
• Using Image Fairness Representations in Diversity-Based Re-ranking for Recommendations
• Problem Learning: Towards the Free Will of Machines
• Two-sided fairness in rankings via Lorenz dominance
• A Reproducibility Study of Product-side Fairness in Bundle Recommendation
• Ranking Across Different Content Types: The Robust Beauty of Multinomial Blending
• Maxmin-Fair Ranking: Individual Fairness under Group-Fairness Constraints
• Learning to Re-rank with Constrained Meta-Optimal Transport
• Algorithmic Fairness Datasets: the Story so Far
• Gender and Race Bias in Consumer Product Recommendations by Large Language Models
• Unfairness Discovery and Prevention For Few-Shot Regression
• Exposure-Based Reinforcement Learning to Rank
• Searching Personal Collections
• Rank-Based Multi-task Learning for Fair Regression
• Estimation of Fair Ranking Metrics with Incomplete Judgments
• Pairwise Fairness for Ordinal Regression
• How Fair is Fairness-aware Representative Ranking and Methods for Fair Ranking
• Information Access Equality on Network Generative Models
• Incentives for Item Duplication under Fair Ranking Policies
• Robust Reputation Independence in Ranking Systems for Multiple Sensitive Attributes
• A Sociotechnical View of Algorithmic Fairness
• The 2021 RecSys Challenge Dataset: Fairness is not optional
• Facets of Fairness in Search and Recommendation
• Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by Ranking Algorithms
• Balancing Fairness and High Match Rates in Reciprocal Recommender Systems: A Nash Social Welfare Approach
• HyperFair: A Soft Approach to Integrating Fairness Criteria
• Practical Compositional Fairness: Understanding Fairness in Multi-Component Recommender Systems
• Fair Meta-Learning For Few-Shot Classification