Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
SAGE: Pushing 2-Bit Vector-Quantized LLMs toward Real-World Usability
Xianglong Yan, Zenan Wu, Kewei Zhang +2
Extreme low-bit weight-only quantization is an effective approach to reducing the deployment costs of large language models. Below 3 bits, scalar quantization often suffers severe…
cs.AI2026
FOCUS: FP4 Optimization via Coupled-Relaxation and Dual-Granularity Scaling
Xianglong Yan, Hong Liu, Chengzhu Bao +4
Large language models (LLMs) achieve remarkable performance but are expensive to deploy due to their enormous size. FP4 quantization, with formats such as MXFP4 and NVFP4, offers a…