5 papers
WHALE: A Scalable Unified Model for Recommendation with Wukong-HSTU Architecture
Renqin Cai, Dawei Sun, Yuanjun Yao +8
As scalability becomes increasingly important in recommendation modeling, recent architectures have advanced the modeling of two broad sources of ranking signals along separate pat…
Efficient Sequential Recommendation for Long Term User Interest Via Personalization
Qiang Zhang, Hanchao Yu, Ivan Ji +14
Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for seque…
Request-Only Optimization for Recommendation Systems
Liang Guo, Wei Li, Lucy Liao +25
Deep Learning Recommendation Models (DLRMs) represent one of the largest machine learning applications on the planet. Industry-scale DLRMs are trained with petabytes of recommendat…
Towards An Efficient LLM Training Paradigm for CTR Prediction
Allen Lin, Renqin Cai, Yun He +5
Large Language Models (LLMs) have demonstrated tremendous potential as the next-generation ranking-based recommendation system. Many recent works have shown that LLMs can significa…
MultiBalance: Multi-Objective Gradient Balancing in Industrial-Scale Multi-Task Recommendation System
Yun He, Xuxing Chen, Jiayi Xu +11
In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources an…