68 citations · 175 across the 21 of their papers we have counts for
1 paper · 1 filter
Longxuan Yu, Bingsen Chen, Peng Shi +9
Speculative decoding accelerates autoregressive LLMs by having a lightweight drafter propose tokens that the target model verifies in parallel. Diffusion-based drafters further red…