Causal Diffusion Transformers for Generative Modeling

Chaorui Deng, Deyao Zhu, Kunchang Li +2

We introduce Causal Diffusion as the autoregressive (AR) counterpart of Diffusion models. It is a next-token(s) forecasting framework that is friendly to both discrete and continuo…