Designing Transformers for Continuous Diffusion Language Models

Weijian Luo, Yujian Chen, Hao Jiang +2

Continuous diffusion language models (CDLMs) offer an alternative approach to parallel language generation; however, most existing studies directly use transformer architectures fr…