Showing cs.ARShow all
2 papers · 1 filter
cs.AR2026
KV-RM: Regularizing KV-Cache Movement for Static-Graph LLM Serving
Zhiqing Zhong, Zhijing Ye, Jian Zhang +3
Static-graph LLM decoders provide predictable launches, fixed tensor shapes, and low submission overhead, but online decoding exposes highly irregular KV-cache behavior: request le…
cs.AR2025
DABench-LLM: Standardized and In-Depth Benchmarking of Post-Moore Dataflow AI Accelerators for LLMs
Ziyu Hu, Zhiqing Zhong, Weijian Zheng +6
The exponential growth of large language models has outpaced the capabilities of traditional CPU and GPU architectures due to the slowdown of Moore's Law. Dataflow AI accelerators…