182 citations · 190 across the 8 of their papers we have counts for
9 papers
Open Benchmark of AI Impact on Humans (ImpactBench): an expert-guided, open platform for the holistic evaluation of AI impact on humans
Chayapatr Archiwaranguprok, Krystal Kirkland, Rachel Poonsiriwong +17
The present work is concerned with how to measure, at scale, the multi-dimensional impact of generative AI models on the individuals who use them. In service of this goal, we intro…
Dissociating the Internal Representations of Sycophancy in LLMs
Anthony Baez, Sheer Karny, Pat Pataranutaporn
Large Language Models (LLMs) frequently exhibit sycophancy, agreeing with a user's statement even when it is incorrect. While often studied as a single, uniform behavior, sycophanc…
Surfacing Neural Activations Over Multi-Turn Conversation Improves User Calibration to LLM Behavioral Drift
Sheer Karny, Anthony Baez, Pat Pataranutaporn
Current human-AI interaction (HAI) only surfaces model outputs, hiding how LLM behavior can shift unpredictably toward unsafe behaviors in multi-turn conversations, potentially und…
AI-Wrapped: Participatory, Privacy-Preserving Measurement of Longitudinal LLM Use In-the-Wild
Cathy Mengying Fang, Sheer Karny, Chayapatr Archiwaranguprok +3
Alignment research on large language models (LLMs) increasingly depends on understanding how these systems are used in everyday contexts. Yet naturalistic interaction data is diffi…
Neural Transparency: Mechanistic Interpretability Interfaces for Anticipating Model Behaviors for Personalized AI
Sheer Karny, Anthony Baez, Pat Pataranutaporn
Millions of users now design personalized LLM-based chatbots that shape their daily interactions, yet they can only roughly anticipate how their design choices will manifest as beh…
Atlas of Human-AI Interaction: An Interactive Knowledge Graph for Research Sensemaking at Scale
Chayapatr Archiwaranguprok, Awu Chen, Rachel Poonsiriwong +4
The growth and fragmentation of scientific literature make it increasingly difficult for researchers to synthesize findings and build on prior work. This paper presents a framework…
"My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Community
Pat Pataranutaporn, Sheer Karny, Chayapatr Archiwaranguprok +3
The emergence of AI companion applications has created novel forms of intimate human-AI relationships, yet empirical research on these communities remains limited. We present the f…
Human-AI Collaboration: Trade-offs Between Performance and Preferences
Lukas William Mayer, Sheer Karny, Jackie Ayoub +4
Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systemati…
What Large Language Models Know and What People Think They Know
Mark Steyvers, Heliodoro Tejeda, Aakriti Kumar +5
As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their output…