978 citations · 1.2k across the 6 of their papers we have counts for
1 paper · 2 filters
Yibo Jin, Yixu Xu, Yue Chen +27
Serving disaggregated large language models has been widely adopted in industrial practice for enhanced performance. However, too many tokens generated in decoding phase, i.e., occ…