2 papers
cs.LG2025
KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
Yuxuan Tian, Zihan Wang, Yebo Peng +6
Efficient inference of large language models (LLMs) is hindered by an ever-growing key-value (KV) cache, making KV cache compression a critical research direction. Traditional meth…
cs.NI2025
LLM-Sketch: Enhancing Network Sketches with LLM
Yuanpeng Li, Zhen Xu, Zongwei Lv +3
Network stream mining is fundamental to many network operations. Sketches, as compact data structures that offer low memory overhead with bounded accuracy, have emerged as a promis…