2 papers
cs.LG2025
PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference
Krishna Teja Chitty-Venkata, Jie Ye, Xian-He Sun +4
KV caching significantly improves the efficiency of Large Language Model (LLM) inference by storing attention states from previously processed tokens, enabling faster generation of…
cs.DC2024
Wilkins: HPC In Situ Workflows Made Easy
Orcun Yildiz, Dmitriy Morozov, Arnur Nigmetov +2
In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however,…