Source-Prior-Driven Selective Adaptation for Efficient Diffusion Model Finetuning

Yi Xiong, Yuan-Yuan Cheng, Xiao-Ming Fu

Fine-tuning large diffusion models for new domains or styles involves a trade-off: improving target-specific generation often degrades the pretrained model's broad generative capab…