8 papers
Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation
Minhao Wang, Yunhang He, Cong Xu +4
Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. However, LLM-based recommenders exh…
Explainable Knowledge Tracing via Probabilistic Embeddings and Pattern-based Reasoning
Siyu Wu, Cong Xu, Wei Zhang
Knowledge Tracing (KT) models students' knowledge states based on learning interactions to predict performance. While deep learning-based KT models have boosted predictive accuracy…
ASPIRE: Make Spectral Graph Collaborative Filtering Great Again via Adaptive Filter Learning
Yunhang He, Cong Xu, Zhangchi Zhu +2
Graph filter design is central to spectral collaborative filtering, yet most existing methods rely on manually tuned hyperparameters rather than fully learnable filters. We show th…
Markovian Pre-Trained Transformer for Next-Item Recommendation
Cong Xu, Guoliang Li, Jun Wang +1
We introduce the Markovian Pre-trained Transformer (MPT) for next-item recommendation, a transferable model fully pre-trained on synthetic Markov chains, yet capable of achieving s…
Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics
Cong Xu, Wenbin Liang, Mo Yu +7
The rapid scaling of models has led to prohibitively high training and fine-tuning costs. A major factor accounting for memory consumption is the widespread use of stateful optimiz…
Collaborative Filtering Meets Spectrum Shift: Connecting User-Item Interaction with Graph-Structured Side Information
Yunhang He, Cong Xu, Jun Wang +1
Graph Neural Networks (GNNs) have demonstrated their superiority in collaborative filtering, where the user-item (U-I) interaction bipartite graph serves as the fundamental data fo…