activity
20202026
most citedVQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference

11 citations · 20 across the 19 of their papers we have counts for

collaborators
Showing cs.OSShow all

1 paper · 1 filter

cs.OS2025★ 1 cited

Towards High-Goodput LLM Serving with Prefill-decode Multiplexing

Yukang Chen, Weihao Cui, Han Zhao +7

Large Language Model (LLM) serving must meet stringent Service Level Objectives (SLOs) for both the prefill and decode phases. Some existing solutions disaggregate the two phases,…