Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
RAP: KV-Cache Compression via RoPE-Aligned Pruning
Jihao Xin, Tian Lyu, David Keyes +2
Long-context inference in large language models (LLMs) is bottlenecked by the memory and compute of the key-value (KV) cache. Structured pruning is a direct way to shrink it: dropp…
cs.LG2025
When Fewer Layers Break More Chains: Layer Pruning Harms Test-Time Scaling in LLMs
Keyu Wang, Tian Lyu, Guinan Su +4
Layer pruning has emerged as a widely adopted technique for improving the efficiency of large language models (LLMs). Although existing methods demonstrate strong performance reten…