5 citations · 5 across the 2 of their papers we have counts for
1 paper · 1 filter
Qipeng Wang
In production environments, large language model (LLM) serving is required to meet stringent service-level objectives (SLOs) amid highly variable request patterns. In practice, req…