Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Beyond Distribution Matching: Selective Margin Preservation for Supervised Fine-Tuning
Yuxuan Wang, Guangxiang Zhao, Xinyu Tan +6
Supervised fine-tuning (SFT) changes logit margins among non-target tokens at teacher-forced prefixes. Matching a local reference distribution keeps those probabilities and also pe…
cs.LG2025
KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
Yuxuan Tian, Zihan Wang, Yebo Peng +6
Efficient inference of large language models (LLMs) is hindered by an ever-growing key-value (KV) cache, making KV cache compression a critical research direction. Traditional meth…