Enabling Creative Exploration for Vibe Design Agents

Abstract

Vibe design agents translate natural-language requests into interfaces, yet repeated generations often converge on similar visual directions. We present an inference architecture that makes design exploration an explicit stage before implementation. A pre-pass proposes structured design specifications with typicality weights, an external policy samples a direction, and the generator implements it under fixed decoding settings. Candidate elicitation draws on Verbalized Sampling. Applied to UI themes and visual-asset prompts, this architecture provides direct control over aesthetic exploration without changing code-generation temperature. Across 168 benchmark prompts, theme sampling expands observed selection coverage from one option to nearly three and increases rendered visual variation. For visual-asset prompts, the strongest observed LLM-judge win/loss ratio is 1.32, with only a small change in whole-screen similarity. Localized aesthetic choices can thus influence judged preference even when the overall screen remains similar. We further evaluate joint theme and asset sampling in a randomized online study conducted over nearly two months, covering 3.39 million tasks and 87,416 labeled conversations. These studies show how explicit design specifications support exploration of alternative UI concepts and help us evaluate their effects on rendered interfaces, judged preference, and user interaction.

24 pages; revised exposition and evaluation, updated figures, and expanded appendix