5 papers
Kunlun: Establishing Scaling Laws for Massive-Scale Recommendation Systems through Unified Architecture Design
Bojian Hou, Xiaolong Liu, Xiaoyi Liu +26
Deriving predictable scaling laws that govern the relationship between model performance and computational investment is crucial for designing and allocating resources in massive-s…
LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
Shali Jiang, Hua Zheng, Boyang Liu +40
Knowledge distillation (KD) transfers a single scalar prediction from a large foundation model (FM) to compact vertical models (VMs), suffering from diminishing transfer ratio -- t…
Hierarchical LoRA MoE for Efficient CTR Model Scaling
Zhichen Zeng, Mengyue Hang, Xiaolong Liu +11
Deep models have driven significant advances in click-through rate (CTR) prediction. While vertical scaling via layer stacking improves model expressiveness, the layer-by-layer seq…
InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction
Zhichen Zeng, Xiaolong Liu, Mengyue Hang +25
Click-through rate (CTR) prediction, which predicts the probability of a user clicking an ad, is a fundamental task in recommender systems. The emergence of heterogeneous informati…
A Collaborative Ensemble Framework for CTR Prediction
Xiaolong Liu, Zhichen Zeng, Xiaoyi Liu +13
Recent advances in foundation models have established scaling laws that enable the development of larger models to achieve enhanced performance, motivating extensive research into…