A Pre-trained Sequential Recommendation Framework: Popularity Dynamics for Zero-shot Transfer

Abstract

Sequential recommenders are crucial to the success of online applications, \eg e-commerce, video streaming, and social media. While model architectures continue to improve, for every new application domain, we still have to train a new model from scratch for high quality recommendations. On the other hand, pre-trained language and vision models have shown great success in zero-shot or few-shot adaptation to new application domains. Inspired by the success of pre-trained models in peer AI fields, we propose a novel pre-trained sequential recommendation framework: PrepRec. We learn universal item representations by modeling item popularity dynamics. Through extensive experiments on five real-world datasets, we show that PrepRec, without any auxiliary information, can not only zero-shot transfer to a new domain, but achieve competitive performance compared to state-of-the-art sequential recommender models with only a fraction of the model size. In addition, with a simple post-hoc interpolation, PrepRec can improve the performance of existing sequential recommenders on average by 13.8\% in Recall@10 and 29.5% in NDCG@10. We provide an anonymized implementation of PrepRec at https://anonymous.4open.science/r/PrepRec--2F60/

References in corpus (9)

• Learning Transferable Visual Models From Natural Language Supervision
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• The origin of bursts and heavy tails in human dynamics
• Session-based Social Recommendation via Dynamic Graph Attention Networks
• CoNet: Collaborative Cross Networks for Cross-Domain Recommendation
• CATN: Cross-Domain Recommendation for Cold-Start Users via Aspect Transfer Network
• Transfer-Meta Framework for Cross-domain Recommendation to Cold-Start Users
• MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation
• A Re-visit of the Popularity Baseline in Recommender Systems

Cited by in corpus (2)

• LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendation
• RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations