One Block Ahead: Promoting Sampler State in Diffusion Language Models

Yangyi Shen, Pin-Jui Ku, Nicolai Oswald +6

Block-diffusion language models denoise a whole block of token positions in parallel so each forward pass can emit many tokens. However, blocks are still denoised in strict sequenc…