2 papers
cs.DC2026
FlexNPU: Transparent NPU Virtualization for Dynamic LLM Prefill-Decode Co-location
Jiongjiong Gu, Jianfeng Wang, Zidong Han +19
Modern AI serving increasingly relies on NPUs for conventional inference and large language model serving. However, current NPU deployments commonly expose physical devices directl…
cs.IR2025
KBest: Efficient Vector Search on Kunpeng CPU
Kaihao Ma, Meiling Wang, Senkevich Oleg +19
Vector search, which returns the vectors most similar to a given query vector from a large vector dataset, underlies many important applications such as search, recommendation, and…