Simplifying and Improving On-Policy Distillation for Few-Step Diffusion

Jiawei Zhang, Ziyu Wan, Nanye Ma +5

Few-step distillation reduces the sampling cost of diffusion and flow models, but existing approaches often require auxiliary score models or specialized architectures. We show tha…