1 paper · 1 filter
Shreyas Kulkarni, Uttam Gurram, Madhav Kanda +5
Block-diffusion speculative decoding accelerates large language model inference by drafting multiple tokens in parallel. However, one-step drafting in discrete diffusion is limited…