activity
20242026
most citedFastPersist: Accelerating Model Checkpointing in Deep Learning

1 citations · 1 across the 3 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.DC2026

PEEK: Predictive Queue-Informed KV Cache Management for LLM Serving

Bing Xie, Zhipeng Wang, Masahiro Tanaka +2

We present PEEK, a lightweight scheduling and eviction framework for both online (streaming) and offline (batch) LLM serving; this paper focuses on the online regime. PEEK maintain…