1 citations · 1 across the 14 of their papers we have counts for
5 papers · 1 filter
Parametric Retrieval-Augmented Generation using Latent Routing of LoRA Adapters
Zhan Su, Fengran Mo, Jinghan Zhang +3
Parametric Retrieval-Augmented Generation (PRAG) is a RAG approach that integrates external knowledge directly into model parameters using a LoRA adapter, aiming at reducing the in…
It Takes Two: Your GRPO Is Secretly DPO
Yihong Wu, Liheng Ma, Lei Ding +9
GRPO has emerged as a prominent reinforcement learning algorithm for post-training LLMs. Unlike critic-based methods, GRPO computes advantages by estimating the \emph{value baselin…
Adaptive Personalized Conversational Information Retrieval
Fengran Mo, Yuchen Hui, Yuxing Tian +5
Personalized conversational information retrieval (CIR) systems aim to satisfy users' complex information needs through multi-turn interactions by considering user profiles. Howeve…
Tensorized Clustered LoRA Merging for Multi-Task Interference
Zhan Su, Fengran Mo, Guojun Liang +4
Despite the success of the monolithic dense paradigm of large language models (LLMs), the LoRA adapters offer an efficient solution by fine-tuning small task-specific modules and m…
Smooth Reading: Bridging the Gap of Recurrent LLM to Self-Attention LLM on Long-Context Tasks
Kai Liu, Zhan Su, Peijie Dong +4
Recently, recurrent large language models (Recurrent LLMs) with linear computational complexity have re-emerged as efficient alternatives to self-attention-based LLMs (Self-Attenti…