23 papers
MERIT: Efficient In-Place Deletion for Dynamic Graph-Based Approximate Nearest Neighbor Indexes
Zekai Wu, Jiabao Jin, Peng Cheng +6
Graph-based indexes have become the dominant approach to approximate nearest neighbor search (ANNS) over high-dimensional data and play a crucial role in real-world applications su…
CMI-Mem: Toward Generalizable Long-Term Memory Management via CMI-Augmented Reinforcement Learning
Yubo Wang, Qiuyu Zhao, Zenghui Sun +6
Memory Manager models are pivotal in agent systems. Existing methods rely predominantly on LLM-judged synthetic question-answer (QA) pairs, making memory valuation dependent on sam…
From Rigid to Dynamic: Entropy-Guided Adaptive Inference for Long-Context LLMs
Zhanchao Xu, Haoyang Li, Qingfa Xiao +4
Existing sparse attention and KV cache compression methods for long-context LLM inference typically apply fixed sparsity patterns or uniform budgets across all attention heads, ove…
Securing Retrieval-Augmented Generation: A Taxonomy of Attacks, Defenses, and Future Directions
Yuming Xu, Mingtao Zhang, Zhuohan Ge +7
Retrieval-augmented generation (RAG) extends large language models (LLMs) with external knowledge, but this access path also introduces security risks that existing work often conf…
QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving
Jianxin Yan, Wangze Ni, Zhenxin Li +8
Retrieval-augmented generation (RAG) improves large language model (LLM) answer quality by grounding generation in external evidence, but processing retrieved contexts makes the pr…
GRACE: A Dynamic Coreset Selection Framework for Large Language Model Optimization
Tianhao Tang, Haoyang Li, Lei Chen
Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, their immense number of parameters and complex tra…