Multi-Token Residual Prediction

Yufeng Xu, Zishuo Bao, Qian Wang +6

Diffusion Language Models (DLMs) generate text by iteratively denoising masked token sequences, offering a tradeoff between parallelism and quality compared to autoregressive model…