106 citations · 154 across the 15 of their papers we have counts for
1 paper · 1 filter
Miles Williams, Young D. Kwon, Rui Li +2
Speculative decoding has rapidly emerged as a leading approach for accelerating language model (LM) inference, as it offers substantial speedups while yielding identical outputs. T…