3 papers
cs.IR2025
Rejuvenating Cross-Entropy Loss in Knowledge Distillation for Recommender Systems
Zhangchi Zhu, Wei Zhang
This paper analyzes Cross-Entropy (CE) loss in knowledge distillation (KD) for recommender systems. KD for recommender systems targets at distilling rankings, especially among item…
cs.IR2024
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective
Zhangchi Zhu, Wei Zhang
In this paper, we analyze the feature-based knowledge distillation for recommendation from the frequency perspective. By defining knowledge as different frequency components of the…
cs.IR2024
Are LLM-based Recommenders Already the Best? Simple Scaled Cross-entropy Unleashes the Potential of Traditional Sequential Recommenders
Cong Xu, Zhangchi Zhu, Mo Yu +3
Large language models (LLMs) have been garnering increasing attention in the recommendation community. Some studies have observed that LLMs, when fine-tuned by the cross-entropy (C…