464 citations · 491 across the 5 of their papers we have counts for
1 paper · 2 filters
Ofir Zafrir, Igor Margulis, Dorin Shteyman +2
Speculative Decoding has gained popularity as an effective technique for accelerating the auto-regressive inference process of Large Language Models. However, Speculative Decoding…