Transformers Learn the Optimal DDPM Denoiser for Multi-Token GMMs

Hongkang Li, Hancheng Min, Rene Vidal

Transformer-based diffusion models have demonstrated remarkable performance at generating high-quality samples. However, our theoretical understanding of the reasons for this succe…