works on
mode collapse 1political attitudes 1semantic similarity rating 1silicon sampling 1survey generation 1text embeddings 1

From the 1 of 5 linked papers with an AI index.

collaborators
Showing stat.APShow all

1 paper · 1 filter

stat.AP2026

Same Prompt, Different Outcomes: Evaluating the Reproducibility of Data Analysis by LLMs

Jiaxin Cui, Rohan Alexander

We systematically evaluate the reproducibility of data analysis conducted by Large Language Models (LLMs). We evaluate two prompting strategies, six models, and four temperature se…