6 papers
Teacher Retains Full Tokens, Student Merges Efficiently: TM20K for E-Commerce Sequence Modeling in Ad Recommendation
Xinchun Li, Duoru Zheng, Wenlin Zhao +13
Benefiting from ultra-long behavior sequence modeling, existing recommender systems bring users a better experience via simultaneously considering their long-term and short-term in…
Rec-Distill: An Industrial Distillation Pipeline for Large-Scale Recommendation Models
Haoran Ding, Wenlin Zhao, Yuchen Jiang +16
Large recommendation models have demonstrated substantial potential gains under scaling laws, yet these gains are difficult to realize in industrial recommendation systems because…
IAT: Instance-As-Token Compression for Historical User Sequence Modeling in Industrial Recommender Systems
Xinchun Li, Ning Zhang, Qianqian Yang +11
Although sophisticated sequence modeling paradigms have achieved remarkable success in recommender systems, the information capacity of hand-crafted sequential features constrains…
TokenMixer-Large: Scaling Up Large Ranking Models in Industrial Recommenders
Yuchen Jiang, Jie Zhu, Xintian Han +18
While scaling laws for recommendation models have gained significant traction, existing architectures such as Wukong, HiFormer and DHEN, often struggle with sub-optimal designs and…
RankMixer: Scaling Up Ranking Models in Industrial Recommenders
Jie Zhu, Zhifang Fan, Xiaoxie Zhu +18
Recent progress on large language models (LLMs) has spurred interest in scaling up recommendation systems, yet two practical obstacles remain. First, training and serving cost on i…
LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenders
Zheng Chai, Qin Ren, Xijun Xiao +14
Modeling ultra-long user behavior sequences is critical for capturing both long- and short-term preferences in industrial recommender systems. Existing solutions typically rely on…