One Latent, Many Tokens: Jointly Learning Compressed Embeddings for Efficient Language Diffusion

Yulin Yuan, Ying Zhang, Xiangming Meng

Most continuous diffusion language models process one latent position per token at each sampling step, making generation expensive. Two-stage methods lower the cost by reducing the…