2 papers
cs.DC2026
Concordia: JIT-Compiled Persistent-Kernel Checkpointing for Fault-Tolerant LLM Inference
Yuhang Gan, Yiwei Yang, Yuyi Li +6
Long-running LLM agents keep valuable state resident on GPUs: KV caches, request schedulers, communication state, and sometimes online adapters. Losing this state after a GPU or co…
cs.DC2025
Optimizing CPU Cache Utilization in Cloud VMs with Accurate Cache Abstraction
Mani Tofigh, Edward Guo, Weiwei Jia +3
This paper shows that cache-based optimizations are often ineffective in cloud virtual machines (VMs) due to limited visibility into and control over provisioned caches. In public…