29 papers
Token-Level Credit Assignment Optimization for Generative Document Retrieval
Xinpeng Zhao, Yang Liu, Ran Chen +6
Generative retrieval models perform document retrieval by autoregressively generating document identifiers (DocIDs). This process naturally forms a sequential decision problem, i.e…
Conflict-Aware Retriever Editing for Knowledge Injection Attacks on LLM-Based RAG Systems
Xinru Liu, Xianglong Zhang, Di Cai +3
Injecting malicious knowledge into retrieval-augmented generation (RAG) systems can manipulate retrieved evidence and mislead downstream generation, posing a serious security threa…
MADS: Model-Aware Diverse Core Set Selection for Instruction Tuning
Yi Bai, Wenhao Zhang, Yao Chen +3
Instruction fine-tuning is employed to enhance the instruction-following ability of large language models (LLMs). As the amount of instruction fine-tuning data increases, selecting…
Integrating Chain-of-Thought into Generative Retrieval: A Preliminary Study
Wenhao Zhang, Ruihao Yu, Yi Bai +2
While generative retrieval (GR) demonstrates competitive performance on standard retrieval benchmarks, existing approaches directly map queries to document identifiers (docids) wit…
Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapse
Chi Zhang, Mengqi Zhang, Xiaotian Ye +5
Sequential knowledge editing in large language models often causes catastrophic collapse of the model's general abilities, especially for parameter-modifying methods. Existing appr…
Reinforced Efficient Reasoning via Semantically Diverse Exploration
Ziqi Zhao, Zhaochun Ren, Jiahong Zou +9
Reinforcement learning with verifiable rewards (RLVR) has proven effective in enhancing the reasoning of large language models (LLMs). Monte Carlo Tree Search (MCTS)-based extensio…