3 papers
cs.DC2026
LiveServe: Interaction-Aware Serving for Real-Time Omni-Modal LLMs
Xiangyu Zhi, Peiqi Yin, Sheng Guan +3
Realtime omni-modal LMs support speech-centric conversations where users stream inputs, hear generated audio, and interrupt freely. Existing Omni-LM serving systems still rely on t…
cs.DB2026
SAQ: Pushing the Limits of Vector Quantization through Code Adjustment and Dimension Segmentation
Hui Li, Shiyuan Deng, Xiao Yan +2
Approximate Nearest Neighbor Search (ANNS) plays a critical role in applications such as search engines, recommender systems, and RAG for LLMs. Vector quantization (VQ), a crucial…
cs.DC2025
Towards Efficient and Scalable Distributed Vector Search with RDMA
Xiangyu Zhi, Meng Chen, Xiao Yan +5
Similarity-based vector search facilitates many important applications such as search and recommendation but is limited by the memory capacity and bandwidth of a single machine due…