Debiasing Sequential Recommenders through Distributionally Robust Optimization over System Exposure

Abstract

Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consistent with the true user preference. Exposure bias refers to the fact that user interactions are dependent upon the partial items exposed to the user. Existing debiasing methods do not make full use of the system exposure data and suffer from sub-optimal recommendation performance and high variance. In this paper, we propose to debias sequential recommenders through Distributionally Robust Optimization (DRO) over system exposure data. The key idea is to utilize DRO to optimize the worst-case error over an uncertainty set to safeguard the model against distributional discrepancy caused by the exposure bias. The main challenge to apply DRO for exposure debiasing in SR lies in how to construct the uncertainty set and avoid the overestimation of user preference on biased samples. Moreover, how to evaluate the debiasing effect on biased test set is also an open question. To this end, we first introduce an exposure simulator trained upon the system exposure data to calculate the exposure distribution, which is then regarded as the nominal distribution to construct the uncertainty set of DRO. Then, we introduce a penalty to items with high exposure probability to avoid the overestimation of user preference for biased samples. Finally, we design a debiased self-normalized inverse propensity score (SNIPS) evaluator for evaluating the debiasing effect on the biased offline test set. We conduct extensive experiments on two real-world datasets to verify the effectiveness of the proposed methods. Experimental results demonstrate the superior exposure debiasing performance of proposed methods. Codes and data are available at \url{https://github.com/nancheng58/DebiasedSR_DRO}.

arXiv commentAccept by WSDM 2024

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Causal Intervention for Leveraging Popularity Bias in Recommendation
• Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
• BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
• Towards Out-Of-Distribution Generalization: A Survey
• Bias and Debias in Recommender System: A Survey and Future Directions
• Degenerate Feedback Loops in Recommender Systems
• Vista: A Visually, Socially, and Temporally-aware Model for Artistic Recommendation
• General factorization framework for context-aware recommendations
• On the User Behavior Leakage from Recommender System Exposure
• Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application
• Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems
• Multi-queue Momentum Contrast for Microvideo-Product Retrieval
• Debiasing the Cloze Task in Sequential Recommendation with Bidirectional Transformers
• Causal Inference in Recommender Systems: A Survey of Strategies for Bias Mitigation, Explanation, and Generalization
• A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing