6 papers
Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs
Yuanjun Feng, Tanzhou Liu, Stefan Feuerriegel +1
Multilingual LLM outputs can vary across sociocultural contexts. However, evidence of cultural grounding can be misleading: identity labels may be inferred from explicit or indirec…
Validated Behavioral Hypotheses as a Lens for Evaluating Participant Simulation
Xuan Liu, HaoYang Shang, Zizhang Liu +5
We propose using validated behavioral hypotheses as a lens for evaluating LLM agents as simulated human participants. This approach makes behavioral agreement in participant simula…
Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
Yuanjun Feng, Vivek Choudhary, Yash Raj Shrestha
Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less a…
Human aversion? Do AI Agents Judge Identity More Harshly Than Performance
Yuanjun Feng, Vivek Chodhary, Yash Raj Shrestha
This study examines the understudied role of algorithmic evaluation of human judgment in hybrid decision-making systems, a critical gap in management research. While extant literat…
Contextualizing Recommendation Explanations with LLMs: A User Study
Yuanjun Feng, Stefan Feuerriegel, Yash Raj Shrestha
Large language models (LLMs) are increasingly prevalent in recommender systems, where LLMs can be used to generate personalized recommendations. Here, we examine how different LLM-…
The Effect of Education in Prompt Engineering: Evidence from Journalists
Amirsiavosh Bashardoust, Yuanjun Feng, Dominique Geissler +2
Large language models (LLMs) are increasingly used in daily work. In this paper, we analyze whether training in prompt engineering can improve the interactions of users with LLMs.…