Denoising Hierarchical Representations: Joint Continuous Diffusion for Language Modeling

Mathias Ollu, Nikos Komodakis

Diffusion Language Models (DLMs) hold the promise of order-agnostic, parallel text generation. Recently, continuous diffusion and flow matching models have seen substantial gains,…