6 citations · 8 across the 12 of their papers we have counts for
6 papers · 1 filter
Scalable Distributed Vector Search via Accuracy Preserving Index Construction
Yuming Xu, Qianxi Zhang, Qi Chen +8
Scaling Approximate Nearest Neighbor Search (ANNS) to billions of vectors requires distributed indexes that balance accuracy, latency, and throughput. Yet existing index designs st…
Attribute Filtering in Approximate Nearest Neighbor Search: An In-depth Experimental Study
Mocheng Li, Xiao Yan, Baotong Lu +3
With the growing integration of structured and unstructured data, new methods have emerged for performing similarity searches on vectors while honoring structured attribute constra…
Towards Efficient and Scalable Distributed Vector Search with RDMA
Xiangyu Zhi, Meng Chen, Xiao Yan +5
Similarity-based vector search facilitates many important applications such as search and recommendation but is limited by the memory capacity and bandwidth of a single machine due…
Towards Robustness: A Critique of Current Vector Database Assessments
Zikai Wang, Qianxi Zhang, Baotong Lu +2
Vector databases are critical infrastructure in AI systems, and average recall is the dominant metric for their evaluation. Both users and researchers rely on it to choose and opti…
AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models
Zeyu Li, Chuanfu Xiao, Yang Wang +6
Quantization has emerged as an effective and lightweight solution to reduce the memory footprint of the KV cache in Large Language Models. Nevertheless, minimizing the accuracy deg…
RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
Yaoqi Chen, Jinkai Zhang, Baotong Lu +16
Recent large language models (LLMs) are rapidly extending their context windows, yet inference throughput lags due to increasing GPU memory and bandwidth demands. This is because t…