6 papers
Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval
Ivan Ji, Liuyi Hu, Harrison +6
The two-tower model has been widely used for large-scale recommendation systems, particularly in the retrieval stage. Industry standards for training two-tower models typically inv…
FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost
Chenhao Feng, Haoli Zhang, Shakhzod Ali-Zade +17
Modern industrial Deep Learning Recommendation Models typically extract user preferences through the analysis of sequential interaction histories, subsequently generating predictio…
Bending the Scaling Law Curve in Large-Scale Recommendation Systems
Qin Ding, Kevin Course, Linjian Ma +19
Learning from user interaction history through sequential models has become a cornerstone of large-scale recommender systems. Recent advances in large language models have revealed…
Efficient Sequential Recommendation for Long Term User Interest Via Personalization
Qiang Zhang, Hanchao Yu, Ivan Ji +14
Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for seque…
S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
Hanqing Zeng, Yinglong Xia, Zhuokai Zhao +7
Fine-tuning pre-trained large language models (LLMs) presents a dual challenge of balancing parameter efficiency and model capacity. Existing methods like low-rank adaptations (LoR…
Realizing Scaling Laws in Recommender Systems: A Foundation-Expert Paradigm for Hyperscale Model Deployment
Dai Li, Kevin Course, Wei Li +13
Scaling laws have been established for recommender systems, yet efficiently deploying foundation model (FM) across multiple recommendation surfaces remains a major unsolved challen…