5 papers
From Scaling to Structured Expressivity: Rethinking Transformers for CTR Prediction
Bencheng Yan, Yuejie Lei, Zhiyuan Zeng +7
Despite massive investments in scale, deep models for click-through rate (CTR) prediction often exhibit rapidly diminishing returns -- a stark contrast to the {predictable scaling…
Unlocking Scaling Law in Industrial Recommendation Systems with a Three-step Paradigm based Large User Model
Bencheng Yan, Shilei Liu, Zhiyuan Zeng +10
Recent advancements in autoregressive Large Language Models (LLMs) have achieved significant milestones, largely attributed to their scalability, often referred to as the "scaling…
RecIS: Sparse to Dense, A Unified Training Framework for Recommendation Models
Hua Zong, Qingtao Zeng, Zhengxiong Zhou +31
In this paper, we propose RecIS, a unified Sparse-Dense training framework designed to achieve two primary goals: 1. Unified Framework To create a Unified sparse-dense training fra…
UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answering
Langming Liu, Shilei Liu, Yujin Yuan +10
Large language models (LLMs) achieve remarkable success in natural language processing (NLP). In practical scenarios like recommendations, as users increasingly seek personalized e…
MIM: Multi-modal Content Interest Modeling Paradigm for User Behavior Modeling
Bencheng Yan, Si Chen, Shichang Jia +12
Click-Through Rate (CTR) prediction is a crucial task in recommendation systems, online searches, and advertising platforms, where accurately capturing users' real interests in con…