Capacity Control is an Effective Memorization Mitigation Mechanism in Text-Conditional Diffusion Models

Raman Dutt, Pedro Sanchez, Ondrej Bohdal +2

In this work, we present compelling evidence that controlling model capacity during fine-tuning can effectively mitigate memorization in diffusion models. Specifically, we demonstr…