Rethinking Preference Alignment for Diffusion Models with Classifier-Free Guidance

Zhou Jiang, Yandong Wen, Zhen Liu

Aligning large-scale text-to-image diffusion models with nuanced human preferences remains challenging. While direct preference optimization (DPO) is simple and effective, large-sc…