179 citations · 179 across the 3 of their papers we have counts for
1 paper · 1 filter
Jeongtae Lee, Minjung Jo, Hyunjoon Jeong +5
Speculative decoding accelerates large language model inference by proposing tokens with a lightweight draft model and selectively accepting them using a target model. This work in…