Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models

Xinxi Zhang, Song Wen, Ligong Han +6

Adapting large-scale pre-trained generative models in a parameter-efficient manner is gaining traction. Traditional methods like low rank adaptation achieve parameter efficiency by…