Publications (226)
Efficient Training of Diffusion Mixture-of-Experts Models: A Practical Recipe
Yahui Liu, Yang Yue, Jingyuan Zhang +5
Recent efforts on Diffusion Mixture-of-Experts (MoE) models have primarily focused on developing more sophisticated routing mechanisms. However, we observe that the underlying arch…
ALPBench: A Benchmark for Attribution-level Long-term Personal Behavior Understanding
Lu Ren, Junda She, Xinchen Luo +23
Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leve…
Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity
Yehui Tang, Xiaosong Li, Fangcheng Liu +19
The surgence of Mixture of Experts (MoE) in Large Language Models promises a small price of execution cost for a much larger model parameter count and learning capacity, because on…
CodeGRAG: Bridging the Gap between Natural Language and Programming Language via Graphical Retrieval Augmented Generation
Kounianhua Du, Jizheng Chen, Renting Rui +7
Utilizing large language models to generate codes has shown promising meaning in software development revolution. Despite the intelligence shown by the large language models, their…
Large-scale Interactive Recommendation with Tree-structured Policy Gradient
Haokun Chen, Xinyi Dai, Han Cai +5
Reinforcement learning (RL) has recently been introduced to interactive recommender systems (IRS) because of its nature of learning from dynamic interactions and planning for long-…
Modular Representation Compression: Adapting LLMs for Efficient and Effective Recommendations
Yunjia Xi, Menghui Zhu, Jianghao Lin +4
Recently, large language models (LLMs) have advanced recommendation systems (RSs), and recent works have begun to explore how to integrate LLMs into industrial RSs. While most appr…
Entropy Ratio Clipping as a Soft Global Constraint for Stable Reinforcement Learning
Zhenpeng Su, Leiyu Pan, Minxuan Lv +7
Large language model post-training relies on reinforcement learning to improve model capability and alignment quality. However, the off-policy training paradigm introduces distribu…
DisCo: Towards Harmonious Disentanglement and Collaboration between Tabular and Semantic Space for Recommendation
Kounianhua Du, Jizheng Chen, Jianghao Lin +6
Recommender systems play important roles in various applications such as e-commerce, social media, etc. Conventional recommendation methods usually model the collaborative signals…
Adaptive Low-Precision Training for Embeddings in Click-Through Rate Prediction
Shiwei Li, Huifeng Guo, Lu Hou +5
Embedding tables are usually huge in click-through rate (CTR) prediction models. To train and deploy the CTR models efficiently and economically, it is necessary to compress their…
SampleLLM: Optimizing Tabular Data Synthesis in Recommendations
Jingtong Gao, Zhaocheng Du, Xiaopeng Li +5
Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall…
Learning Structure and Knowledge Aware Representation with Large Language Models for Concept Recommendation
Qingyao Li, Wei Xia, Kounianhua Du +4
Concept recommendation aims to suggest the next concept for learners to study based on their knowledge states and the human knowledge system. While knowledge states can be predicte…
GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment
Minxuan Lv, Tiehua Mei, Tanlong Du +9
We present GoLongRL, a fully open-source, capability-oriented post-training recipe for long-context reinforcement learning with verifiable rewards (RLVR). Existing long-context RL…
Advancing and Benchmarking Personalized Tool Invocation for LLMs
Xu Huang, Yuefeng Huang, Weiwen Liu +5
Tool invocation is a crucial mechanism for extending the capabilities of Large Language Models (LLMs) and has recently garnered significant attention. It enables LLMs to solve comp…
ReLoop2: Building Self-Adaptive Recommendation Models via Responsive Error Compensation Loop
Jieming Zhu, Guohao Cai, Junjie Huang +3
Industrial recommender systems face the challenge of operating in non-stationary environments, where data distribution shifts arise from evolving user behaviors over time. To tackl…
MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models
Jianghao Lin, Xinyuan Wang, Xinyi Dai +5
Tool retrieval is a critical component in enabling large language models (LLMs) to interact effectively with external tools. It aims to precisely filter the massive tools into a sm…
ReLoop: A Self-Correction Continual Learning Loop for Recommender Systems
Guohao Cai, Jieming Zhu, Quanyu Dai +4
Deep learning-based recommendation has become a widely adopted technique in various online applications. Typically, a deployed model undergoes frequent re-training to capture users…
LLM4CD: Leveraging Large Language Models for Open-World Knowledge Augmented Cognitive Diagnosis
Weiming Zhang, Lingyue Fu, Qingyao Li +7
Cognitive diagnosis (CD) plays a crucial role in intelligent education, evaluating students' comprehension of knowledge concepts based on their test histories. However, current CD…
DeepFM: An End-to-End Wide & Deep Learning Framework for CTR Prediction
Huifeng Guo, Ruiming Tang, Yunming Ye +3
Learning sophisticated feature interactions behind user behaviors is critical in maximizing CTR for recommender systems. Despite great progress, existing methods have a strong bias…
Action-Aware Generative Sequence Modeling for Short Video Recommendation
Wenhao Li, Zihan Lin, Zhengxiao Guo +7
The paper proposes a new recommendation model, A2Gen, that treats user actions on short videos as temporal sequences and uses attention and hierarchical encoding to predict future…
MISS: Multi-Interest Self-Supervised Learning Framework for Click-Through Rate Prediction
Wei Guo, Can Zhang, Zhicheng He +6
CTR prediction is essential for modern recommender systems. Ranging from early factorization machines to deep learning based models in recent years, existing CTR methods focus on c…
AIE: Auction Information Enhanced Framework for CTR Prediction in Online Advertising
Yang Yang, Bo Chen, Chenxu Zhu +6
Click-Through Rate (CTR) prediction is a fundamental technique for online advertising recommendation and the complex online competitive auction process also brings many difficultie…
Quantized Inference for OneRec-V2
Yi Su, Xinchen Luo, Hongtao Cheng +7
Quantized inference has demonstrated substantial system-level benefits in large language models while preserving model quality. In contrast, reliably applying low-precision quantiz…
UniFormer: Efficient and Unified Model-Centric Scaling for Industrial Recommendation
Bo Chen, Jinlong Jiao, Tijian Hu +12
Recently, substantial progress has been made in industrial recommendation through component-centric model scaling, where individual components such as behavior modeling, feature in…
OneLoc: Geo-Aware Generative Recommender Systems for Local Life Service
Zhipeng Wei, Kuo Cai, Junda She +8
Local life service is a vital scenario in Kuaishou App, where video recommendation is intrinsically linked with store's location information. Thus, recommendation in our scenario i…
Large Language Models Make Sample-Efficient Recommender Systems
Jianghao Lin, Xinyi Dai, Rong Shan +4
Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resemble…
Kelix Technical Report
Boyang Ding, Chenglong Chu, Dunju Zang +28
Autoregressive large language models (LLMs) scale well by expressing diverse tasks as sequences of discrete natural-language tokens and training with next-token prediction, which u…
Towards Efficient and Effective Unlearning of Large Language Models for Recommendation
Hangyu Wang, Jianghao Lin, Bo Chen +4
The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec ari…
On Effective Scheduling of Model-based Reinforcement Learning
Hang Lai, Jian Shen, Weinan Zhang +5
Model-based reinforcement learning has attracted wide attention due to its superior sample efficiency. Despite its impressive success so far, it is still unclear how to appropriate…
Towards Low-loss 1-bit Quantization of User-item Representations for Top-K Recommendation
Yankai Chen, Yifei Zhang, Yingxue Zhang +5
Due to the promising advantages in space compression and inference acceleration, quantized representation learning for recommender systems has become an emerging research direction…
Schema as Parameterized Tools for Universal Information Extraction
Sheng Liang, Yongyue Zhang, Yaxiong Wu +2
Universal information extraction (UIE) primarily employs an extractive generation approach with large language models (LLMs), typically outputting structured information based on p…
Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning
Weiwen Liu, Feng Liu, Ruiming Tang +3
Fairness in recommendation has attracted increasing attention due to bias and discrimination possibly caused by traditional recommenders. In Interactive Recommender Systems (IRS),…
AdvKT: An Adversarial Multi-Step Training Framework for Knowledge Tracing
Lingyue Fu, Ting Long, Jianghao Lin +6
Knowledge Tracing (KT) monitors students' knowledge states and simulates their responses to question sequences. Existing KT models typically follow a single-step training paradigm,…
AutoFT: Automatic Fine-Tune for Parameters Transfer Learning in Click-Through Rate Prediction
Xiangli Yang, Qing Liu, Rong Su +3
Recommender systems are often asked to serve multiple recommendation scenarios or domains. Fine-tuning a pre-trained CTR model from source domains and adapting it to a target domai…
DPWriter: Reinforcement Learning with Diverse Planning Branching for Creative Writing
Qian Cao, Yahui Liu, Wei Bi +6
Reinforcement learning (RL)-based enhancement of large language models (LLMs) often leads to reduced output diversity, undermining their utility in open-ended tasks like creative w…
Humanity's Last Code Exam: Can Advanced LLMs Conquer Human's Hardest Code Competition?
Xiangyang Li, Xiaopeng Li, Kuicai Dong +7
Code generation is a core capability of large language models (LLMs), yet mainstream benchmarks (e.g., APPs and LiveCodeBench) contain questions with medium-level difficulty and po…
OneRec-V2 Technical Report
Guorui Zhou, Hengrui Hu, Hongtao Cheng +72
Recent breakthroughs in generative AI have transformed recommender systems through end-to-end generation. OneRec reformulates recommendation as an autoregressive generation task, a…
Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answering
Kuicai Dong, Yujing Chang, Shijie Huang +3
Document Visual Question Answering (DocVQA) faces dual challenges in processing lengthy multimodal documents (text, images, tables) and performing cross-modal reasoning. Current do…
Beyond Positive History: Re-ranking with List-level Hybrid Feedback
Muyan Weng, Yunjia Xi, Weiwen Liu +5
As the last stage of recommender systems, re-ranking generates a re-ordered list that aligns with the user's preference. However, previous works generally focus on item-level posit…
Scenario-Aware Hierarchical Dynamic Network for Multi-Scenario Recommendation
Jingtong Gao, Bo Chen, Menghui Zhu +6
Click-Through Rate (CTR) prediction is a fundamental technique in recommendation and advertising systems. Recent studies have shown that implementing multi-scenario recommendations…
CAPTS: Channel-Aware, Preference-Aligned Trigger Selection for Multi-Channel Item-to-Item Retrieval
Xiaoyou Zhou, Yuqi Liu, Zhao Liu +4
Large-scale industrial recommender systems commonly adopt multi-channel retrieval for candidate generation, combining direct user-to-item (U2I) retrieval with two-hop user-to-item-…
PROMISE: Process Reward Models Unlock Test-Time Scaling Laws in Generative Recommendations
Chengcheng Guo, Kuo Cai, Yu Zhou +5
Generative Recommendation has emerged as a promising paradigm, reformulating recommendation as a sequence-to-sequence generation task over hierarchical Semantic IDs. However, exist…
ATGen: Adversarial Reinforcement Learning for Test Case Generation
Qingyao Li, Xinyi Dai, Weiwen Liu +5
Large Language Models (LLMs) excel at code generation, yet their outputs often contain subtle bugs, for which effective test cases are a critical bottleneck. Existing test generati…
RecCocktail: A Generalizable and Efficient Framework for LLM-Based Recommendation
Min Hou, Chenxi Bai, Le Wu +6
Large Language Models (LLMs) have achieved remarkable success in recent years, owing to their impressive generalization capabilities and rich world knowledge. To capitalize on the…
ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction
Jianghao Lin, Bo Chen, Hangyu Wang +7
Click-through rate (CTR) prediction has become increasingly indispensable for various Internet applications. Traditional CTR models convert the multi-field categorical data into ID…
DropNAS: Grouped Operation Dropout for Differentiable Architecture Search
Weijun Hong, Guilin Li, Weinan Zhang +4
Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation t…
OneReason Technical Report
OneRec Team, Biao Yang, Boyang Ding +81
Generative recommendation models in the OneRec family have been widely deployed in many real-world services, such as short-video, live-streaming, advertising, and e-commerce. Howev…
MuonRec: Shifting the Optimizer Paradigm Beyond Adam in Scalable Generative Recommendation
Rong Shan, Aofan Yu, Bo Chen +7
Recommender systems (RecSys) are increasingly emphasizing scaling, leveraging larger architectures and more interaction data to improve personalization. Yet, despite the optimizer'…
Dual Graph enhanced Embedding Neural Network for CTR Prediction
Wei Guo, Rong Su, Renhao Tan +5
CTR prediction, which aims to estimate the probability that a user will click an item, plays a crucial role in online advertising and recommender system. Feature interaction modeli…
Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning
Sijin Zhou, Xinyi Dai, Haokun Chen +5
Interactive recommender system (IRS) has drawn huge attention because of its flexible recommendation strategy and the consideration of optimal long-term user experiences. To deal w…
FuXi-β: Towards a Lightweight and Fast Large-Scale Generative Recommendation Model
Yufei Ye, Wei Guo, Hao Wang +7
Scaling laws for autoregressive generative recommenders reveal potential for larger, more versatile systems but mean greater latency and training costs. To accelerate training and…
An Adversarial Imitation Click Model for Information Retrieval
Xinyi Dai, Jianghao Lin, Weinan Zhang +7
Modern information retrieval systems, including web search, ads placement, and recommender systems, typically rely on learning from user feedback. Click models, which study how use…
CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension
Rui Li, Zeyu Zhang, Xiaohe Bo +5
Current Large Language Models (LLMs) are confronted with overwhelming information volume when comprehending long-form documents. This challenge raises the imperative of a cohesive…
Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models
Yunjia Xi, Weiwen Liu, Jianghao Lin +8
Recommender systems (RSs) play a pervasive role in today's online services, yet their closed-loop nature constrains their access to open-world knowledge. Recently, large language m…
From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
Yaxiong Wu, Sheng Liang, Chen Zhang +5
Memory is the process of encoding, storing, and retrieving information, allowing humans to retain experiences, knowledge, skills, and facts over time, and serving as the foundation…
Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender System
Bowei He, Xu He, Renrui Zhang +3
With the continuous increase of users and items, conventional recommender systems trained on static datasets can hardly adapt to changing environments. The high-throughput data req…
DARL: Encouraging Diverse Answers for General Reasoning without Verifiers
Chongxuan Huang, Lei Lin, Xiaodong Shi +2
Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated promising gains in enhancing the reasoning capabilities of large language models. However, its dependence on…
Instruction-Tuning Data Synthesis from Scratch via Web Reconstruction
Yuxin Jiang, Yufei Wang, Chuhan Wu +8
The improvement of LLMs' instruction-following capabilities depends critically on the availability of high-quality instruction-response pairs. While existing automatic data synthet…
Learning to Edit: Aligning LLMs with Knowledge Editing
Yuxin Jiang, Yufei Wang, Chuhan Wu +9
Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inp…
Recall-Augmented Ranking: Enhancing Click-Through Rate Prediction Accuracy with Cross-Stage Data
Junjie Huang, Guohao Cai, Jieming Zhu +4
Click-through rate (CTR) prediction plays an indispensable role in online platforms. Numerous models have been proposed to capture users' shifting preferences by leveraging user be…
Embedding Compression in Recommender Systems: A Survey
Shiwei Li, Huifeng Guo, Xing Tang +4
To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are emp…
Intent-aware Multi-source Contrastive Alignment for Tag-enhanced Recommendation
Haolun Wu, Yingxue Zhang, Chen Ma +4
To offer accurate and diverse recommendation services, recent methods use auxiliary information to foster the learning process of user and item representations. Many SOTA methods f…
GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder
Yu Zhou, Chengcheng Guo, Kuo Cai +6
While generative recommendations (GR) possess strong sequential reasoning capabilities, they face significant challenges when processing extremely long user behavior sequences: the…
QA4PRF: A Question Answering based Framework for Pseudo Relevance Feedback
Handong Ma, Jiawei Hou, Chenxu Zhu +6
Pseudo relevance feedback (PRF) automatically performs query expansion based on top-retrieved documents to better represent the user's information need so as to improve the search…
Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendation
Jiachen Zhu, Jianghao Lin, Xinyi Dai +6
We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhan…
GRank: Towards Target-Aware and Streamlined Industrial Retrieval with a Generate-Rank Framework
Yijia Sun, Shanshan Huang, Zhiyuan Guan +4
Industrial-scale recommender systems rely on a cascade pipeline in which the retrieval stage must return a high-recall candidate set from billions of items under tight latency. Exi…
FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction
Hangyu Wang, Jianghao Lin, Xiangyang Li +5
Click-through rate (CTR) prediction plays as a core function module in various personalized online services. The traditional ID-based models for CTR prediction take as inputs the o…
A Survey of Personalization: From RAG to Agent
Xiaopeng Li, Pengyue Jia, Derong Xu +11
Personalization has become an essential capability in modern AI systems, enabling customized interactions that align with individual user preferences, contexts, and goals. Recent r…
SITA: Semantic Interest Tokens for Target-Aware Compression in Long-Sequence Recommendation
Rui Zhou, Bo Chen, Qinglin Jia +5
As user behavior histories continue to grow on modern Internet platforms, effectively modeling long behavior sequences has become crucial for predicting user interests in candidate…
REASONER: An Explainable Recommendation Dataset with Multi-aspect Real User Labeled Ground Truths Towards more Measurable Explainable Recommendation
Xu Chen, Jingsen Zhang, Lei Wang +6
Explainable recommendation has attracted much attention from the industry and academic communities. It has shown great potential for improving the recommendation persuasiveness, in…
Compressed Interaction Graph based Framework for Multi-behavior Recommendation
Wei Guo, Chang Meng, Enming Yuan +8
Multi-types of user behavior data (e.g., clicking, adding to cart, and purchasing) are recorded in most real-world recommendation scenarios, which can help to learn users' multi-fa…
Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction
Bin Liu, Ruiming Tang, Yingzhi Chen +3
Click-Through Rate prediction is an important task in recommender systems, which aims to estimate the probability of a user to click on a given item. Recently, many deep models hav…
From Tags to Trees: Structuring Fine-Grained Knowledge for Controllable Data Selection in LLM Instruction Tuning
Zihan Niu, Wenping Hu, Junmin Chen +3
Effective and controllable data selection is critical for LLM instruction tuning, especially with massive open-source datasets. Existing approaches primarily rely on instance-level…
RethinkMCTS: Refining Erroneous Thoughts in Monte Carlo Tree Search for Code Generation
Qingyao Li, Wei Xia, Kounianhua Du +5
Tree search methods have demonstrated impressive performance in code generation. Previous methods combine tree search with reflection that summarizes past mistakes to achieve itera…
NL-Debugging: Exploiting Natural Language as an Intermediate Representation for Code Debugging
Weiming Zhang, Qingyao Li, Xinyi Dai +7
Debugging is a critical aspect of LLM's coding ability. Early debugging efforts primarily focused on code-level analysis, which often falls short when addressing complex programmin…
Retrievable Domain-Sensitive Feature Memory for Multi-Domain Recommendation
Yuang Zhao, Zhaocheng Du, Qinglin Jia +3
With the increase in the business scale and number of domains in online advertising, multi-domain ad recommendation has become a mainstream solution in the industry. The core of mu…
AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction
Bin Liu, Chenxu Zhu, Guilin Li +6
Learning feature interactions is crucial for click-through rate (CTR) prediction in recommender systems. In most existing deep learning models, feature interactions are either manu…
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation
Pengyue Jia, Derong Xu, Xiaopeng Li +9
The reranker and generator are two critical components in the Retrieval-Augmented Generation (i.e., RAG) pipeline, responsible for ranking relevant documents and generating respons…
Counteraction-Aware Multi-Teacher On-Policy Distillation for General Capability Recovery with Domain Preservation
Tianlei Chen, Jiao Ou, Ziyuan Liu +3
Domain specialization can improve LLM behavior in vertical domains, but often weakens the general capabilities inherited from the original model. Recent Multi-Teacher On-Policy Dis…
Play to Your Strengths: Collaborative Intelligence of Conventional Recommender Models and Large Language Models
Yunjia Xi, Weiwen Liu, Jianghao Lin +5
The rise of large language models (LLMs) has opened new opportunities in Recommender Systems (RSs) by enhancing user behavior modeling and content understanding. However, current a…
PEAR: Personalized Re-ranking with Contextualized Transformer for Recommendation
Yi Li, Jieming Zhu, Weiwen Liu +6
The goal of recommender systems is to provide ordered item lists to users that best match their interests. As a critical task in the recommendation pipeline, re-ranking has receive…
OpenOneRec Technical Report
Guorui Zhou, Honghui Bao, Jiaming Huang +44
While the OneRec series has successfully unified the fragmented recommendation pipeline into an end-to-end generative framework, a significant gap remains between recommendation sy…
Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation
Derong Xu, Pengyue Jia, Xiaopeng Li +9
Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph…
Multi-Task Deep Recommender Systems: A Survey
Yuhao Wang, Ha Tsz Lam, Yi Wong +6
Multi-task learning (MTL) aims at learning related tasks in a unified model to achieve mutual improvement among tasks considering their shared knowledge. It is an important topic i…
A Practical Incremental Method to Train Deep CTR Models
Yichao Wang, Huifeng Guo, Ruiming Tang +2
Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of d…
LLM4Rerank: LLM-based Auto-Reranking Framework for Recommendations
Jingtong Gao, Bo Chen, Weiwen Liu +6
Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused p…
Aligning Crowd Feedback via Distributional Preference Reward Modeling
Dexun Li, Cong Zhang, Kuicai Dong +3
Deep Reinforcement Learning is widely used for aligning Large Language Models (LLM) with human preference. However, the conventional reward modelling is predominantly dependent on…
OneRec-Think: In-Text Reasoning for Generative Recommendation
Zhanyu Liu, Shiyao Wang, Xingmei Wang +23
The powerful generative capacity of Large Language Models (LLMs) has instigated a paradigm shift in recommendation. However, existing generative models (e.g., OneRec) operate as im…
DIET: Learning to Distill Dataset Continually for Recommender Systems
Jiaqing Zhang, Hao Wang, Mingjia Yin +6
Modern deep recommender models are trained under a continual learning paradigm, relying on massive and continuously growing streaming behavioral logs. In large-scale platforms, ret…
Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation
Rong Shan, Jiachen Zhu, Jianghao Lin +5
In this paper, we address the lifelong sequential behavior incomprehension problem in large language models (LLMs) for recommendation, where LLMs struggle to extract useful informa…
Product-based Neural Networks for User Response Prediction over Multi-field Categorical Data
Yanru Qu, Bohui Fang, Weinan Zhang +5
User response prediction is a crucial component for personalized information retrieval and filtering scenarios, such as recommender system and web search. The data in user response…
OneLive: Dynamically Unified Generative Framework for Live-Streaming Recommendation
Shen Wang, Yusheng Huang, Ruochen Yang +15
Live-streaming recommender system serves as critical infrastructure that bridges the patterns of real-time interactions between users and authors. Similar to traditional industrial…
ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation
Jianghao Lin, Rong Shan, Chenxu Zhu +6
With large language models (LLMs) achieving remarkable breakthroughs in natural language processing (NLP) domains, LLM-enhanced recommender systems have received much attention and…
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems
Yuening Wang, Yingxue Zhang, Antonios Valkanas +4
Recommender systems now consume large-scale data and play a significant role in improving user experience. Graph Neural Networks (GNNs) have emerged as one of the most effective re…
Deep Learning for Click-Through Rate Estimation
Weinan Zhang, Jiarui Qin, Wei Guo +2
Click-through rate (CTR) estimation plays as a core function module in various personalized online services, including online advertising, recommender systems, and web search etc.…
Collaborative Filtering with Graph-based Implicit Feedback
Minzhe Niu, Weinan Zhang, Yanru Qu +4
Introducing consumed items as users' implicit feedback in matrix factorization (MF) method, SVD++ is one of the most effective collaborative filtering methods for personalized reco…
No One Left Behind: How to Exploit the Incomplete and Skewed Multi-Label Data for Conversion Rate Prediction
Qinglin Jia, Zhaocheng Du, Chuhan Wu +4
In most real-world online advertising systems, advertisers typically have diverse customer acquisition goals. A common solution is to use multi-task learning (MTL) to train a unifi…
LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation
Yuhao Wang, Yichao Wang, Zichuan Fu +4
As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much att…
CoIR: A Comprehensive Benchmark for Code Information Retrieval Models
Xiangyang Li, Kuicai Dong, Yi Quan Lee +5
Despite the substantial success of Information Retrieval (IR) in various NLP tasks, most IR systems predominantly handle queries and corpora in natural language, neglecting the dom…
Retrieval & Interaction Machine for Tabular Data Prediction
Jiarui Qin, Weinan Zhang, Rong Su +5
Prediction over tabular data is an essential task in many data science applications such as recommender systems, online advertising, medical treatment, etc. Tabular data is structu…
ToolACE: Winning the Points of LLM Function Calling
Weiwen Liu, Xu Huang, Xingshan Zeng +24
Function calling significantly extends the application boundary of large language models, where high-quality and diverse training data is critical for unlocking this capability. Ho…