1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.DC2025
P/D-Device: Disaggregated Large Language Model between Cloud and Devices
Yibo Jin, Yixu Xu, Yue Chen +27
Serving disaggregated large language models has been widely adopted in industrial practice for enhanced performance. However, too many tokens generated in decoding phase, i.e., occ…
cs.DC2024★ 1 cited
P/D-Serve: Serving Disaggregated Large Language Model at Scale
Yibo Jin, Tao Wang, Huimin Lin +27
Serving disaggregated large language models (LLMs) over tens of thousands of xPU devices (GPUs or NPUs) with reliable performance faces multiple challenges. 1) Ignoring the diversi…