4 citations · 7 across the 13 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Discovering KV Cache Eviction Policies via LLM-Guided Program Evolution
Pratik Poudel, Yanzhao Wu, Sumit Jha +1
KV cache compression is critical for long-context inference, yet effective eviction policies remain difficult to design: existing prefill-stage methods often rely on hand-crafted s…
cs.DC2024
CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration
Hongpeng Jin, Yanzhao Wu
Large Language Models (LLMs) exhibit remarkable human-like predictive capabilities. However, it is challenging to deploy LLMs to provide efficient and adaptive inference services a…