Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
PackKV: Reducing KV Cache Memory Footprint through LLM-Aware Lossy Compression
Bo Jiang, Taolue Yang, Youyuan Liu +3
Transformer-based large language models (LLMs) have demonstrated remarkable potential across a wide range of practical applications. However, long-context inference remains a signi…
cs.DC2025
KVComp: A High-Performance, LLM-Aware, Lossy Compression Framework for KV Cache
Bo Jiang, Taolue Yang, Youyuan Liu +3
Transformer-based large language models (LLMs) demonstrate impressive potential in various practical applications. However, long context inference poses a significant challenge due…
cs.DC2024
NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compression
Wenqi Jia, Zhewen Hu, Youyuan Liu +10
Large-scale scientific simulations generate massive datasets, posing challenges for storage and I/O. Traditional lossy compression struggles to advance more in balancing compressio…