Multi-Stream Residual Computation in Diffusion Language Models

Ekaterina Alimaskina, Suren Kazarian, Gleb Molodtsov +1

Diffusion language models reconstruct masked tokens in parallel, offering an alternative to autoregressive generation. Yet their Transformer backbones typically carry visible evide…