3 papers
cs.IR2025
A Simple and Effective Framework for Symmetric Consistent Indexing in Large-Scale Dense Retrieval
Huimu Wang, Yiming Qiu, Xingzhi Yao +5
Dense retrieval has become the industry standard in large-scale information retrieval systems due to its high efficiency and competitive accuracy. Its core relies on a coarse-to-fi…
cs.AR2024
UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture
Sitian Chen, Amelie Chi Zhou, Yucheng Shi +2
Approximate Nearest Neighbor Search (ANNS) is a critical component of modern AI systems, such as recommendation engines and retrieval-augmented large language models (RAG-LLMs). Ho…
cs.CL2024
An Efficient Inference Framework for Early-exit Large Language Models
Ruijie Miao, Yihan Yan, Xinshuo Yao +1
Building efficient inference framework has gained increasing interests for research community. Early-exit models, a variant of LLMs, improves the inference efficiency of LLMs by sk…