Recent Advances in the Foundations and Applications of Unbiased Learning to Rank

Abstract

Since its inception, the field of unbiased learning to rank (ULTR) has remained very active and has seen several impactful advancements in recent years. This tutorial provides both an introduction to the core concepts of the field and an overview of recent advancements in its foundations along with several applications of its methods. The tutorial is divided into four parts: Firstly, we give an overview of the different forms of bias that can be addressed with ULTR methods. Secondly, we present a comprehensive discussion of the latest estimation techniques in the ULTR field. Thirdly, we survey published results of ULTR in real-world applications. Fourthly, we discuss the connection between ULTR and fairness in ranking. We end by briefly reflecting on the future of ULTR research and its applications. This tutorial is intended to benefit both researchers and industry practitioners who are interested in developing new ULTR solutions or utilizing them in real-world applications.

SIGIR 2023 - Tutorial

References in corpus (9)

• Controlling Fairness and Bias in Dynamic Learning-to-Rank
• Unifying Online and Counterfactual Learning to Rank
• When Inverse Propensity Scoring does not Work: Affine Corrections for Unbiased Learning to Rank
• Doubly Robust Off-Policy Evaluation for Ranking Policies under the Cascade Behavior Model
• Maximizing Marginal Fairness for Dynamic Learning to Rank
• Cascade Model-based Propensity Estimation for Counterfactual Learning to Rank
• Taking the Counterfactual Online: Efficient and Unbiased Online Evaluation for Ranking
• Safe Deployment for Counterfactual Learning to Rank with Exposure-Based Risk Minimization
• Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Ranking