D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models

Liyuan Zhang, Jiarui Zhang, Jinwei Yao +6

Speculative decoding accelerates autoregressive large language model inference by drafting multiple tokens and verifying them in a single target-model forward pass. Recent diffusio…