From the 1 of 17 linked papers with an AI index.
1 citations · 1 across the 12 of their papers we have counts for
3 papers · 1 filter
MERIT: Efficient In-Place Deletion for Dynamic Graph-Based Approximate Nearest Neighbor Indexes
Zekai Wu, Jiabao Jin, Peng Cheng +6
Graph-based indexes have become the dominant approach to approximate nearest neighbor search (ANNS) over high-dimensional data and play a crucial role in real-world applications su…
QCFuse: Query-Centric Cache Fusion for Efficient RAG Inference
Jianxin Yan, Zeheng Qian, Wangze Ni +6
Cache fusion accelerates generation process of LLMs equipped with RAG through KV caching and selective token recomputation, thereby reducing computational costs and improving effic…
RAC: Relation-Aware Cache Replacement for Large Language Models
Yuchong Wu, Zihuan Xu, Wangze Ni +5
The scaling of Large Language Model (LLM) services faces significant cost and latency challenges, making effective caching under tight capacity crucial. Existing cache replacement…