activity
20242026
most citedLoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism

2 citations · 3 across the 8 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.DC2025

TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving

Bingyang Wu, Zili Zhang, Yinmin Zhong +4

Prefix caching is crucial to accelerate multi-turn interactions and requests with shared prefixes. At the cluster level, existing prefix caching systems are tightly coupled with re…

cs.LG2025★ 1 cited

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation

Yinmin Zhong, Zili Zhang, Xiaoniu Song +11

Reinforcement learning (RL) has become the core post-training technique for large language models (LLMs). RL for LLMs involves two stages: generation and training. The LLM first ge…