8 papers
QV-PIC: Query-Aware Visual Position-Independent Caching for Efficient RAG Serving
Yilin Liu, Rui Meng, Wangze Ni +5
Retrieval-Augmented Generation (RAG) repeatedly prefills identical text chunks across queries, incurring redundant computations. Position-Independent Caching (PIC) mitigates it by…
FGIM: a Fast Graph-based Indexes Merging Framework for Approximate Nearest Neighbor Search
Zekai Wu, Jiabao Jin, Peng Cheng +7
As the state-of-the-art methods for high-dimensional data retrieval, Approximate Nearest Neighbor Search (ANNS) approaches with graph-based indexes have attracted increasing attent…
RAC: Relation-Aware Cache Replacement for Large Language Models
Yuchong Wu, Zihuan Xu, Wangze Ni +5
The scaling of Large Language Model (LLM) services faces significant cost and latency challenges, making effective caching under tight capacity crucial. Existing cache replacement…
Infinite Stream Estimation under Personalized -Event Privacy
Leilei Du, Peng Cheng, Lei Chen +3
Streaming data collection is indispensable for stream data analysis, such as event monitoring. However, publishing these data directly leads to privacy leaks. -event privacy is…
ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models
Jianxin Yan, Wangze Ni, Lei Chen +4
Semantic caching significantly reduces computational costs and improves efficiency by storing and reusing large language model (LLM) responses. However, existing systems rely prima…
Efficient Multiple Temporal Network Kernel Density Estimation
Yu Shao, Peng Cheng, Xiang Lian +5
Kernel density estimation (KDE) has become a popular method for visual analysis in various fields, such as financial risk forecasting, crime clustering, and traffic monitoring. KDE…