Varif.ai to Vary and Verify User-Driven Diversity in Scalable Image Generation
arXiv:2506.19644 · doi:10.1145/3715336.3735847
Abstract
Diversity in image generation is essential to ensure fair representations and support creativity in ideation. Hence, many text-to-image models have implemented diversification mechanisms. Yet, after a few iterations of generation, a lack of diversity becomes apparent, because each user has their own diversity goals (e.g., different colors, brands of cars), and there are diverse attributions to be specified. To support user-driven diversity control, we propose Varif.ai that employs text-to-image and Large Language Models to iteratively i) (re)generate a set of images, ii) verify if user-specified attributes have sufficient coverage, and iii) vary existing or new attributes. Through an elicitation study, we uncovered user needs for diversity in image generation. A pilot validation showed that Varif.ai made achieving diverse image sets easier. In a controlled evaluation with 20 participants, Varif.ai proved more effective than baseline methods across various scenarios. Thus, this supports user control of diversity in image generation for creative ideation and scalable image generation.
DIS2025, code available at github.com/mario-michelessa/varifai
References in corpus (10)
- Hierarchical Text-Conditional Image Generation with CLIP Latents
- The Effects of Generative AI on Design Fixation and Divergent Thinking
- PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation
- RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions
- PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
- PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactions
- GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial Network
- Directed Diversity: Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideation
- GANravel: User-Driven Direction Disentanglement in Generative Adversarial Networks
- Representation Online Matters: Practical End-to-End Diversification in Search and Recommender Systems