Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding

Jiakun Fan, Min Xiao, Qiang Wang +5

Speculative decoding accelerates large language model inference through parallel verification of tokens proposed by a drafter. Diffusion drafters further parallelize proposal gener…