48 citations
2 papers
cs.IR2020★ 48 cited
When Inverse Propensity Scoring does not Work: Affine Corrections for Unbiased Learning to Rank
Ali Vardasbi, Harrie Oosterhuis, Maarten de Rijke
Besides position bias, which has been well-studied, trust bias is another type of bias prevalent in user interactions with rankings: users are more likely to click incorrectly w.r.…
cs.IR2020★ 21 cited
Taking the Counterfactual Online: Efficient and Unbiased Online Evaluation for Ranking
Harrie Oosterhuis, Maarten de Rijke
Counterfactual evaluation can estimate Click-Through-Rate (CTR) differences between ranking systems based on historical interaction data, while mitigating the effect of position bi…