KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videos

Abstract

Recommender systems deployed in real-world applications can have inherent exposure bias, which leads to the biased logged data plaguing the researchers. A fundamental way to address this thorny problem is to collect users' interactions on randomly expose items, i.e., the missing-at-random data. A few works have asked certain users to rate or select randomly recommended items, e.g., Yahoo!, Coat, and OpenBandit. However, these datasets are either too small in size or lack key information, such as unique user ID or the features of users/items. In this work, we present KuaiRand, an unbiased sequential recommendation dataset containing millions of intervened interactions on randomly exposed videos, collected from the video-sharing mobile App, Kuaishou. Different from existing datasets, KuaiRand records 12 kinds of user feedback signals (e.g., click, like, and view time) on randomly exposed videos inserted in the recommendation feeds in two weeks. To facilitate model learning, we further collect rich features of users and items as well as users' behavior history. By releasing this dataset, we enable the research of advanced debiasing large-scale recommendation scenarios for the first time. Also, with its distinctive features, KuaiRand can support various other research directions such as interactive recommendation, long sequential behavior modeling, and multi-task learning. The dataset and its news will be available at https://kuairand.com.

arXiv commentCIKM '22 Resource Paper. Dataset Webpage: https://kuairand.com

References in corpus (8)

• A Contextual-Bandit Approach to Personalized News Article Recommendation
• Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction
• Bias and Debias in Recommender System: A Survey and Future Directions
• Offline A/B testing for Recommender Systems
• Counterfactual Risk Minimization: Learning from Logged Bandit Feedback
• Evaluating Conversational Recommender Systems via User Simulation
• Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate
• Constrained Reinforcement Learning for Short Video Recommendation

Cited by in corpus (22)

• Alleviating Matthew Effect of Offline Reinforcement Learning in Interactive Recommendation
• Multi-Task Recommendations with Reinforcement Learning
• Exploration and Regularization of the Latent Action Space in Recommendation
• SIGformer: Sign-aware Graph Transformer for Recommendation
• Uncovering User Interest from Biased and Noised Watch Time in Video Recommendation
• Generative Flow Network for Listwise Recommendation
• Towards Robust Recommendation via Decision Boundary-aware Graph Contrastive Learning
• Online Item Cold-Start Recommendation with Popularity-Aware Meta-Learning
• Collaboration and Transition: Distilling Item Transitions into Multi-Query Self-Attention for Sequential Recommendation
• Future Impact Decomposition in Request-level Recommendations
• ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systems
• Multi-Granularity Distribution Modeling for Video Watch Time Prediction via Exponential-Gaussian Mixture Network
• PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching
• LLM-Enhanced Reinforcement Learning for Long-Term User Satisfaction in Interactive Recommendation
• On the Reliability of Sampling Strategies in Offline Recommender Evaluation
• Not All Videos Become Outdated: Short-Video Recommendation by Learning to Deconfound Release Interval Bias
• Value Function Decomposition in Markov Recommendation Process
• Guaranteeing Accuracy and Fairness under Fluctuating User Traffic: A Bankruptcy-Inspired Re-ranking Approach
• DP-Rec: Towards Dynamic Patching for Efficient Long-Sequence Recommendation
• HyperZero: A Customized End-to-End Auto-Tuning System for Recommendation with Hourly Feedback
• Reward Balancing Revisited: Enhancing Offline Reinforcement Learning for Recommender Systems
• Interest Changes: Considering User Interest Life Cycle in Recommendation System