5 papers
From Scaling to Structured Expressivity: Rethinking Transformers for CTR Prediction
Bencheng Yan, Yuejie Lei, Zhiyuan Zeng +7
Despite massive investments in scale, deep models for click-through rate (CTR) prediction often exhibit rapidly diminishing returns -- a stark contrast to the {predictable scaling…
Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers
Liangyu Wang, Siqi Zhang, Junjie Wang +7
The scaling of Large Language Models (LLMs) drives interest in matrix-based optimizers (e.g., Shampoo, Muon, SOAP) for their convergence efficiency; yet their requirement for holis…
Unlocking Scaling Law in Industrial Recommendation Systems with a Three-step Paradigm based Large User Model
Bencheng Yan, Shilei Liu, Zhiyuan Zeng +10
Recent advancements in autoregressive Large Language Models (LLMs) have achieved significant milestones, largely attributed to their scalability, often referred to as the "scaling…
RecGPT Technical Report
Chao Yi, Dian Chen, Gaoyang Guo +51
Recommender systems are among the most impactful applications of artificial intelligence, serving as critical infrastructure connecting users, merchants, and platforms. However, mo…
UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answering
Langming Liu, Shilei Liu, Yujin Yuan +10
Large language models (LLMs) achieve remarkable success in natural language processing (NLP). In practical scenarios like recommendations, as users increasingly seek personalized e…