Understanding LoRA Rank Trade-offs in Diffusion Model Fine-Tuning

Iman Khazrak, Narges Nejad, Mostafa M. Rezaee +1

Selecting LoRA rank for diffusion fine-tuning requires balancing quality and compute cost. We present a controlled study on CIFAR-10 using a DDPM U-Net with ranks {2,4,8,16,32}, fi…