Mitigating Hallucinations in Diffusion Models through Adaptive Attention Modulation

Trevine Oorloff, Yaser Yacoob, Abhinav Shrivastava

Diffusion models, while increasingly adept at generating realistic images, are notably hindered by hallucinations -- unrealistic or incorrect features inconsistent with the trained…