7 citations · 7 across the 2 of their papers we have counts for
1 paper · 1 filter
Fangcheng Liu, Yehui Tang, Zhenhua Liu +3
Speculative decoding has demonstrated its effectiveness in accelerating the inference of large language models while maintaining a consistent sampling distribution. However, the co…