12 citations · 12 across the 10 of their papers we have counts for
1 paper · 2 filters
Avinash Kumar, Sujay Sanghavi, Poulami Das
Speculative decoding accelerates LLM inference by using a fast draft model to generate tokens and a more accurate target model to verify them. Its performance depends on the $\text…