collaborators

1 paper

cs.LG2026

Speculative Diffusion is a Tale of Two Tradeoffs

Aaron Zorel, Guy Van den Broeck, Aditya Grover +1

Speculative decoding is a technique that accelerates the inference speed of autoregressive large language models (LLMs) by sampling from a faster, lower quality draft model. Tradit…