5 papers
Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation
Minhao Wang, Yunhang He, Cong Xu +4
Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. However, LLM-based recommenders exh…
Rejuvenating Cross-Entropy Loss in Knowledge Distillation for Recommender Systems
Zhangchi Zhu, Wei Zhang
This paper analyzes Cross-Entropy (CE) loss in knowledge distillation (KD) for recommender systems. KD for recommender systems targets at distilling rankings, especially among item…
Pattern-wise Transparent Sequential Recommendation
Kun Ma, Cong Xu, Zeyuan Chen +1
A transparent decision-making process is essential for developing reliable and trustworthy recommender systems. For sequential recommendation, it means that the model can identify…
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective
Zhangchi Zhu, Wei Zhang
In this paper, we analyze the feature-based knowledge distillation for recommendation from the frequency perspective. By defining knowledge as different frequency components of the…
Preference-Consistent Knowledge Distillation for Recommender System
Zhangchi Zhu, Wei Zhang
Feature-based knowledge distillation has been applied to compress modern recommendation models, usually with projectors that align student (small) recommendation models' dimensions…