25 papers
Token-Level Credit Assignment Optimization for Generative Document Retrieval
Xinpeng Zhao, Yang Liu, Ran Chen +6
Generative retrieval models perform document retrieval by autoregressively generating document identifiers (DocIDs). This process naturally forms a sequential decision problem, whe…
OpenReward: Learning to Reward Long-form Agentic Tasks via Reinforcement Learning
Ziyou Hu, Zhengliang Shi, Minghang Zhu +5
Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, exist…
Do Generative Recommenders Deepen the Information Cocoon? A Closed-Loop Simulation with LLM-powered User Simulators
Jiyuan Yang, Gengxin Sun, Mengqi Zhang +5
Recommender systems alleviate information overload, yet repeated feedback between recommendations and user interactions can reinforce existing preferences and narrow users' exposur…
MADS: Model-Aware Diverse Core Set Selection for Instruction Tuning
Yi Bai, Wenhao Zhang, Yao Chen +3
Instruction fine-tuning is employed to enhance the instruction-following ability of large language models (LLMs). As the amount of instruction fine-tuning data increases, selecting…
Integrating Chain-of-Thought into Generative Retrieval: A Preliminary Study
Wenhao Zhang, Ruihao Yu, Yi Bai +2
While generative retrieval (GR) demonstrates competitive performance on standard retrieval benchmarks, existing approaches directly map queries to document identifiers (docids) wit…
Model Editing for New Document Integration in Generative Information Retrieval
Zhen Zhang, Zihan Wang, Xinyu Ma +6
Generative retrieval (GR) reformulates the Information Retrieval (IR) task as the generation of document identifiers (docIDs). Despite its promise, existing GR models exhibit poor…