Structuring The Future: Diffusion LLM Speculative Decoding via Calibrated Draft Graphs

Sudhanshu Agrawal, Risheek Garrepalli, Raghavv Goel +3

Diffusion LLMs (dLLMs) have recently emerged as a powerful alternative to autoregressive LLMs (AR-LLMs) with the potential to operate at significantly higher token-generation rates…