collaborators

1 paper

cs.DC2025

Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving

Xiaoxiang Shi, Colin Cai, Junjia Du +1

Monolithic serving with chunked prefill improves GPU utilization by batching prefill and decode together, but suffers from fine-grained phase interference. Engine-level prefill-dec…