Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect
arXiv:2009.09226
Abstract
Recommender systems aim to provide item recommendations for users, and are usually faced with data sparsity problem (e.g., cold start) in real-world scenarios. Recently pre-trained models have shown their effectiveness in knowledge transfer between domains and tasks, which can potentially alleviate the data sparsity problem in recommender systems. In this survey, we first provide a review of recommender systems with pre-training. In addition, we show the benefits of pre-training to recommender systems through experiments. Finally, we discuss several promising directions for future research for recommender systems with pre-training.
arXiv commentThis paper is submitted to Frontiers in Big Data and is under review
References in corpus (11)
- Distributed Representations of Words and Phrases and their Compositionality
- Language Models are Few-Shot Learners
- Pre-trained Models for Natural Language Processing: A Survey
- Recurrent Neural Networks with Top-k Gains for Session-based Recommendations
- Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences
- K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
- BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning
- Deep Reinforcement Learning for List-wise Recommendations
- Structured Pruning of a BERT-based Question Answering Model
- Pre-training of Context-aware Item Representation for Next Basket Recommendation
- Graph Embedding Based Hybrid Social Recommendation System