Scaling Diffusion Transformers Efficiently via $\mu$P

Chenyu Zheng, Xinyu Zhang, Rongzhen Wang +5

Diffusion Transformers have emerged as the foundation for vision generative models, but their scalability is limited by the high cost of hyperparameter (HP) tuning at large scales.…