4 papers
Markovian Pre-Trained Transformer for Next-Item Recommendation
Cong Xu, Guoliang Li, Jun Wang +1
We introduce the Markovian Pre-trained Transformer (MPT) for next-item recommendation, a transferable model fully pre-trained on synthetic Markov chains, yet capable of achieving s…
Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics
Cong Xu, Wenbin Liang, Mo Yu +7
The rapid scaling of models has led to prohibitively high training and fine-tuning costs. A major factor accounting for memory consumption is the widespread use of stateful optimiz…
Collaborative Filtering Meets Spectrum Shift: Connecting User-Item Interaction with Graph-Structured Side Information
Yunhang He, Cong Xu, Jun Wang +1
Graph Neural Networks (GNNs) have demonstrated their superiority in collaborative filtering, where the user-item (U-I) interaction bipartite graph serves as the fundamental data fo…
STAIR: Manipulating Collaborative and Multimodal Information for E-Commerce Recommendation
Cong Xu, Yunhang He, Jun Wang +1
While the mining of modalities is the focus of most multimodal recommendation methods, we believe that how to fully utilize both collaborative and multimodal information is pivotal…