most citedTowards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

2 citations · 2 across the 3 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

Coordinated Scheduling for MoE LLM Serving

Yifan Sun, Zhexiang Zhang, Jiantong Jiang +5

Serving Mixture-of-Experts (MoE) large language models (LLMs) is challenging because dynamic request workloads interact with sparse expert routing, creating both data-parallel (DP)…