2 papers
cs.DC2026
Varuna: Enabling Failure-Type Aware RDMA Failover
Xiaoyang Wang, Yongkun Li, Lulu Yao +7
RDMA link failures can render connections temporarily unavailable, causing both performance degradation and significant recovery overhead. To tolerate such failures, production dat…
cs.LG2026
LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference
Jiawei Yi, Ping Gong, Youhui Bai +10
During LLM inference, KVCache memory usage grows linearly with sequence length and batch size and often exceeds GPU capacity. Recent proposals offload KV states to host memory and…