1 citations · 2 across the 7 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.LG2026
ChampionKV: Head-Wise Adaptive Budget Allocation for KV Cache Compression
Yuechuan Chen, Yanda Guo, Xiaoxi Liu +4
Some observation-window-based KV cache compressors use prompt attention to identify important tokens but allocate uniform or predefined budgets across heads, overlooking input-depe…
cs.LG2026
Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
Chengqian Zhang, Wei Zhu, Kyumin Lee
Post-training has become essential for adapting large language models (LLMs) to complex downstream behaviors, including instruction following, preference alignment, and multi-step…
cs.CL2026
ShapLoRA: Allocation of Low-rank Adaption on Large Language Models via Shapley Value Inspired Importance Estimation
Yi Zhao, Qinghua Yao, Xinyuan song +1
Low-rank adaption (LoRA) is a representative method in the field of parameter-efficient fine-tuning (PEFT), and is key to Democratizating the modern large language models (LLMs). T…