Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
MultiAlloc: Budget-Aware Precision Allocation for KV Cache Quantization
Yangchengyu Zhou, Zhiping Wu, Runchang Jiang +5
The Key-Value (KV) cache constitutes a dominant source of memory consumption during large language model (LLM) inference, particularly in long-context and complex reasoning scenari…
cs.LG2025
ECVL-ROUTER: Scenario-Aware Routing for Vision-Language Models
Xin Tang, Youfang Han, Fangfei Gou +7
Vision-Language Models (VLMs) excel in diverse multimodal tasks. However, user requirements vary across scenarios, which can be categorized into fast response, high-quality output,…