2 papers
cs.LG2026
PRQuant: Permutation Residual Quantization for Low-Overhead Inference
Peiran Wang, Anqi Wang, Jiaying Zhao +10
Low-bit quantization of linear layers is often dominated by a small number of outlier channels. Existing smoothing, rotation, and residual-based methods can mitigate this issue, bu…
cs.DC2026
FlexNPU: Transparent NPU Virtualization for Dynamic LLM Prefill-Decode Co-location
Jiongjiong Gu, Jianfeng Wang, Zidong Han +19
Modern AI serving increasingly relies on NPUs for conventional inference and large language model serving. However, current NPU deployments commonly expose physical devices directl…