Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect

Abstract

Recommender systems aim to provide item recommendations for users, and are usually faced with data sparsity problem (e.g., cold start) in real-world scenarios. Recently pre-trained models have shown their effectiveness in knowledge transfer between domains and tasks, which can potentially alleviate the data sparsity problem in recommender systems. In this survey, we first provide a review of recommender systems with pre-training. In addition, we show the benefits of pre-training to recommender systems through experiments. Finally, we discuss several promising directions for future research for recommender systems with pre-training.

This paper is submitted to Frontiers in Big Data and is under review

References in corpus (4)

• Language Models are Few-Shot Learners
• Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences
• BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning
• Pre-training of Context-aware Item Representation for Next Basket Recommendation