activity
20232026
most citedCloud Native System for LLM Inference Serving

1 citations · 3 across the 7 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.DC2026

CoCoScale: Leveraging Layer-wise Scaling to Unlock the Potential of Online LLM Serving

Jingfeng Wu, Yiyuan He, Minxian Xu +7

Online large language model (LLM) serving has become the backbone of modern AI applications, powering diverse downstream services through shared hardware clusters. However, modern…