Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations

Abstract

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction performance. In contrast, unbiased ratings obtained from randomized controlled trials or A/B tests are considered to be the golden standard, but are costly and small in scale in reality. To exploit both types of data, recent works proposed to use unbiased ratings to correct the parameters of the propensity or imputation models trained on the biased dataset. However, the existing methods fail to obtain accurate predictions in the presence of unobserved confounding or model misspecification. In this paper, we propose a theoretically guaranteed model-agnostic balancing approach that can be applied to any existing debiasing method with the aim of combating unobserved confounding and model misspecification. The proposed approach makes full use of unbiased data by alternatively correcting model parameters learned with biased data, and adaptively learning balance coefficients of biased samples for further debiasing. Extensive real-world experiments are conducted along with the deployment of our proposal on four representative debiasing methods to demonstrate the effectiveness.

Accepted Paper in WWW'23

References in corpus (9)

• Causal Intervention for Leveraging Popularity Bias in Recommendation
• Collaborative Filtering and the Missing at Random Assumption
• AutoDebias: Learning to Debias for Recommendation
• Deconfounded Recommendation for Alleviating Bias Amplification
• Offline A/B testing for Recommender Systems
• Enhanced Doubly Robust Learning for Debiasing Post-click Conversion Rate Estimation
• TDR-CL: Targeted Doubly Robust Collaborative Learning for Debiased Recommendations
• StableDR: Stabilized Doubly Robust Learning for Recommendation on Data Missing Not at Random
• On the Opportunity of Causal Learning in Recommendation Systems: Foundation, Estimation, Prediction and Challenges

Cited by in corpus (5)

• How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective
• Leveraging Watch-time Feedback for Short-Video Recommendations: A Causal Labeling Framework
• Pareto Invariant Representation Learning for Multimedia Recommendation
• LabelCraft: Empowering Short Video Recommendations with Automated Label Crafting
• Addressing Correlated Latent Exogenous Variables in Debiased Recommender Systems