1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Jianxing Qin, Alexander Du, Danfeng Zhang +2
LLM inference systems may vary batch composition, prompt chunking, prefill/decode execution, and KV-cache reuse, eviction, or recomputation. These optimizations should not affect s…