2 papers
cs.LG2026
GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache
Soosung Kim, Minjae Park, Eui-Young Chung +1
The deployment of Large Language Models (LLMs) with extended context windows is increasingly constrained by the linear growth of Key-Value (KV) cache memory. Vector Quantization (V…
cs.CL2025
Prompt-based Depth Pruning of Large Language Models
Juyun Wee, Minjae Park, Jaeho Lee
Depth pruning aims to reduce the inference cost of a large language model without any hardware-specific complications, by simply removing several less important transformer blocks.…