13 papers
QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving
Jianxin Yan, Wangze Ni, Zhenxin Li +8
Retrieval-augmented generation (RAG) improves large language model (LLM) answer quality by grounding generation in external evidence, but processing retrieved contexts makes the pr…
Explaining the "Why": A Unified Framework for the Additive Attribution of Changes in Arbitrary Measures
Changsheng Zhou, Dajun Chen, Zhitao Shen +3
Explaining why aggregated measures change is a critical challenge in data analytics that existing systems struggle to address. While current attribution methods exist, they lack a…
QCFuse: Query-Centric Cache Fusion for Efficient RAG Inference
Jianxin Yan, Zeheng Qian, Wangze Ni +6
Cache fusion accelerates generation process of LLMs equipped with RAG through KV caching and selective token recomputation, thereby reducing computational costs and improving effic…
FGIM: a Fast Graph-based Indexes Merging Framework for Approximate Nearest Neighbor Search
Zekai Wu, Jiabao Jin, Peng Cheng +7
As the state-of-the-art methods for high-dimensional data retrieval, Approximate Nearest Neighbor Search (ANNS) approaches with graph-based indexes have attracted increasing attent…
SINDI: An Efficient Index for Sparse Vector Approximate Maximum Inner Product Search
Ruoxuan Li, Xiaoyao Zhong, Jiabao Jin +7
Sparse vector Maximum Inner Product Search (MIPS) is crucial in multi-path retrieval for Retrieval-Augmented Generation (RAG). Recent inverted index-based and graph-based algorithm…
Approximate Nearest Neighbor Search of Large Scale Vectors on Distributed Storage
Kun Yu, Jiabao Jin, Xiaoyao Zhong +6
Approximate Nearest Neighbor Search (ANNS) in high-dimensional space is an essential operator in many online services, such as information retrieval and recommendation. Indices con…