CoSam: An Efficient Collaborative Adaptive Sampler for Recommendation
arXiv:2011.07739
Abstract
Sampling strategies have been widely applied in many recommendation systems to accelerate model learning from implicit feedback data. A typical strategy is to draw negative instances with uniform distribution, which however will severely affect model's convergency, stability, and even recommendation accuracy. A promising solution for this problem is to over-sample the ``difficult'' (a.k.a informative) instances that contribute more on training. But this will increase the risk of biasing the model and leading to non-optimal results. Moreover, existing samplers are either heuristic, which require domain knowledge and often fail to capture real ``difficult'' instances; or rely on a sampler model that suffers from low efficiency. To deal with these problems, we propose an efficient and effective collaborative sampling method CoSam, which consists of: (1) a collaborative sampler model that explicitly leverages user-item interaction information in sampling probability and exhibits good properties of normalization, adaption, interaction information awareness, and sampling efficiency; and (2) an integrated sampler-recommender framework, leveraging the sampler model in prediction to offset the bias caused by uneven sampling. Correspondingly, we derive a fast reinforced training algorithm of our framework to boost the sampler performance and sampler-recommender collaboration. Extensive experiments on four real-world datasets demonstrate the superiority of the proposed collaborative sampler model and integrated sampler-recommender framework.
arXiv comment21pages, submitting to TOIS
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- Semi-Supervised Classification with Graph Convolutional Networks
- Inductive Representation Learning on Large Graphs
- BPR: Bayesian Personalized Ranking from Implicit Feedback
- xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
- Learning Tree-based Deep Model for Recommender Systems
- Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems
- Outer Product-based Neural Collaborative Filtering
- A Novel User Representation Paradigm for Making Personalized Candidate Retrieval