1 citations · 1 across the 5 of their papers we have counts for
7 papers
Stability-Plasticity Balance via Singular-Vector Selection in LLM Continual Learning
Lingxiang Wang, Hainan Zhang, Liang Pang +2
Domain-specific continual adaptation of LLMs risks catastrophic forgetting, creating a fundamental tension between acquiring new capabilities and preserving those learned during pr…
Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented Generation
Qianchi Zhang, Hainan Zhang, Liang Pang +2
Retrieval-Augmented Generation (RAG) has become a key paradigm for reducing factual hallucinations in Large Language Models (LLMs), yet little is known about how the order of retri…
Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?
JiaYing Zheng, HaiNan Zhang, Liang Pang +2
Multi-turn RAG systems often face queries with colloquial omissions and ambiguous references, posing significant challenges for effective retrieval and generation. Traditional quer…
Privacy-Preserving Reasoning with Knowledge-Distilled Parametric Retrieval Augmented Generation
Jinwen Chen, Hainan Zhang, Liang Pang +5
The current RAG system requires uploading plaintext documents to the cloud, risking private data leakage. Parametric RAG (PRAG) encodes documents as LoRA parameters within LLMs, of…
Learning to Erase Private Knowledge from Multi-Documents for Retrieval-Augmented Large Language Models
Yujing Wang, Jinwen Chen, Hainan Zhang +5
Retrieval-Augmented Generation (RAG) is a promising technique for applying LLMs to proprietary domains. However, retrieved documents may contain sensitive knowledge, posing risks o…
AdaComp: Extractive Context Compression with Adaptive Predictor for Retrieval-Augmented Large Language Models
Qianchi Zhang, Hainan Zhang, Liang Pang +2
Retrieved documents containing noise will hinder RAG from detecting answer clues and make the inference process slow and expensive. Therefore, context compression is necessary to e…
MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Models
Yujing Wang, Hainan Zhang, Liang Pang +3
In a real-world RAG system, the current query often involves spoken ellipses and ambiguous references from dialogue contexts, necessitating query rewriting to better describe user'…