2 papers
cs.LG2026
MultiAlloc: Budget-Aware Precision Allocation for KV Cache Quantization
Yangchengyu Zhou, Zhiping Wu, Runchang Jiang +5
The Key-Value (KV) cache constitutes a dominant source of memory consumption during large language model (LLM) inference, particularly in long-context and complex reasoning scenari…
cs.CV2026
RGSQ: Riemannian Geometry-Sensitive Quantization for Large Vision-Language Models
Zhiping Wu, Dongdong Ren, Yangchengyu Zhou +4
Large vision-language models (VLMs) can be efficiently deployed under stringent memory and latency constraints through post training quantization (PTQ). However, most PTQ methods a…