Distilling Adversarial Prompts from Safety Benchmarks: Report for the Adversarial Nibbler Challenge

Manuel Brack, Patrick Schramowski, Kristian Kersting

Text-conditioned image generation models have recently achieved astonishing image quality and alignment results. Consequently, they are employed in a fast-growing number of applica…