Scaling and Distilling Text Embeddings for Better Diffusibility

Zekai Zhang, Yunjie Tian, Yanjin He +4

Diffusion language models (DLMs) offer a promising alternative to autoregressive (AR) language generation. Recent advances in continuous DLMs, which apply latent diffusion to conti…