3 citations · 6 across the 13 of their papers we have counts for
13 papers
Total Simulated Survey Error: Designing and Diagnosing Survey Responses from Large Language Models
Indira Sen, Georg Ahnert, Leah von der Heyde +3
Large Language models (LLMs), having been trained on vast amounts of human-generated data, may encode the attitudes and behaviors of these humans. As such, LLMs show promise in mim…
When Persona Attributes Improve Population Alignment in Large Language Models
Leon Fröhling, Jens Rupprecht, Markus Strohmaier +1
Large Language Models (LLMs) are increasingly used to predict the responses of human participants in survey panels. Towards that goal, persona prompting has recently emerged as a t…
QSTN: A Modular Framework for Robust Questionnaire Inference with Large Language Models
Maximilian Kreutner, Jens Rupprecht, Georg Ahnert +2
We introduce QSTN, an open-source Python framework for systematically generating responses from questionnaire-style prompts to support in-silico surveys and annotation tasks with l…
German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
Jens Rupprecht, Leon Fröhling, Claudia Wagner +1
The use of Large Language Models (LLMs) for simulating human perspectives via persona prompting is gaining traction in computational social science. However, well-curated, empirica…
Survey Response Generation: Generating Closed-Ended Survey Responses In-Silico with Large Language Models
Georg Ahnert, Anna-Carolina Haensch, Barbara Plank +1
Many in-silico simulations of human survey responses with large language models (LLMs) focus on generating closed-ended survey responses, whereas LLMs are typically trained to gene…
Neural network embeddings recover value dimensions from psychometric survey items on par with human data
Max Pellert, Clemens M. Lechner, Indira Sen +1
We demonstrate that embeddings derived from large language models, when processed with "Survey and Questionnaire Item Embeddings Differentials" (SQuID), can recover the structure o…
The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models
Marlene Lutz, Indira Sen, Georg Ahnert +2
Persona prompting is increasingly used in large language models (LLMs) to simulate views of various sociodemographic groups. However, how a persona prompt is formulated can signifi…
Prompt Perturbations Reveal Human-Like Biases in Large Language Model Survey Responses
Jens Rupprecht, Georg Ahnert, Markus Strohmaier
Large Language Models (LLMs) are increasingly used as proxies for human subjects in social science surveys, but their reliability and susceptibility to known human-like response bi…
Simulating Persuasive Dialogues on Meat Reduction with Generative Agents
Georg Ahnert, Elena Wurth, Markus Strohmaier +1
Meat reduction benefits human and planetary health, but social norms keep meat central in shared meals. To date, the development of communication strategies that promote meat reduc…
Extracting Affect Aggregates from Longitudinal Social Media Data with Temporal Adapters for Large Language Models
Georg Ahnert, Max Pellert, David Garcia +1
This paper proposes temporally aligned Large Language Models (LLMs) as a tool for longitudinal analysis of social media data. We fine-tune Temporal Adapters for Llama 3 8B on full…
ReSi: A Comprehensive Benchmark for Representational Similarity Measures
Max Klabunde, Tassilo Wald, Tobias Schumacher +3
Measuring the similarity of different representations of neural architectures is a fundamental task and an open research challenge for the machine learning community. This paper pr…
Toxic comments reduce the activity of volunteer editors on Wikipedia
Ivan Smirnov, Camelia Oprea, Markus Strohmaier
Wikipedia is one of the most successful collaborative projects in history. It is the largest encyclopedia ever created, with millions of users worldwide relying on it as the first…
Quota-based debiasing can decrease representation of already underrepresented groups
Ivan Smirnov, Florian Lemmerich, Markus Strohmaier
Many important decisions in societies such as school admissions, hiring, or elections are based on the selection of top-ranking individuals from a larger pool of candidates. This p…