DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
arXiv:2502.09867 · doi:10.1145/3706598.3714211
Abstract
Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that effectively explore a product design space. To understand how experts explore and communicate about design spaces, we conducted a formative study with 12 experienced product designers and found that experts -- and their less-versed clients -- often use visual references to guide co-design discussions rather than written descriptions. These insights inspired DesignWeaver, an interface that helps novices generate prompts for a text-to-image model by surfacing key product design dimensions from generated images into a palette for quick selection. In a study with 52 novices, DesignWeaver enabled participants to craft longer prompts with more domain-specific vocabularies, resulting in more diverse, innovative product designs. However, the nuanced prompts heightened participants' expectations beyond what current text-to-image models could deliver. We discuss implications for AI-based product design support tools.
26 pages, 22 figures, CHI 2025
References in corpus (8)
- Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
- Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
- Graphologue: Exploring Large Language Model Responses with Interactive Diagrams
- "What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Models
- PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactions
- Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
- Prompting for products: Investigating design space exploration strategies for text-to-image generative models
- MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback