1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Yibo Jin, Yixu Xu, Yue Chen +27
Serving disaggregated large language models has been widely adopted in industrial practice for enhanced performance. However, too many tokens generated in decoding phase, i.e., occ…