Showing 2026Show all
3 papers · 1 filter
cs.AI2026
DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction
Aozhong Zhang, Selcuk Gurses, Yanxia Deng +8
Key-value (KV) cache management has become a critical bottleneck for scaling Large Language Models (LLMs) to long-context scenarios due to linear memory growth. While recent evicti…
cs.LG2026
ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces
Xun Dong, Yibo Xu, Naigang Wang +3
Zeroth-order (ZO) optimization enables fine-tuning large language models when backpropagation is unavailable or memory-prohibitive, but existing methods often perturb full model we…
cs.CV2026
Weight Group-wise Post-Training Quantization for Medical Foundation Model
Yineng Chen, Peng Huang, Aozhong Zhang +9
Foundation models have achieved remarkable results in medical image analysis. However, its large network architecture and high computational complexity significantly impact inferen…