Within-Model vs Between-Prompt Variability in Large Language Models for Creative Tasks

Jennifer Haase, Jana Gonnermann-Müller, Paul H. P. Hanel +4

How much of LLM output variance is explained by prompts versus model choice versus stochasticity through sampling? We answer this by evaluating 12 LLMs on 10 creativity prompts wit…