1 citations · 1 across the 4 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
CacheFlow: Efficient LLM Serving via Automated 3D-Parallel KV Cache Restoration
Sean Nian, Jiahao Fang, Hanzhang Shen +3
KV cache restoration is becoming a major bottleneck in long-context LLM serving, including multi-turn conversations, agentic workloads, and RAG. Existing advances largely treat res…
cs.DC2024
PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training
Jiahao Fang, Huizheng Wang, Qize Yang +5
Deep learning (DL) models are piquing high interest and scaling at an unprecedented rate. To this end, a handful of tiled accelerators have been proposed to support such large-scal…