1 citations · 1 across the 1 of their papers we have counts for
1 paper · 1 filter
Yukang Chen, Weihao Cui, Han Zhao +7
Large Language Model (LLM) serving must meet stringent Service Level Objectives (SLOs) for both the prefill and decode phases. Some existing solutions disaggregate the two phases,…