2 citations · 2 across the 6 of their papers we have counts for
7 papers
Low-Cost Assays for Measuring Model Behavior Across Vendors and Releases
Tapan Parikh
Language models advise people, keep them company, and write software while they sleep. Measuring what they do is hard: behavior has to be sampled repeatedly across models, prompts…
Conduct Under Pressure: What Sixty Language Models Do When a User Pushes
Tapan Parikh
We study what LLMs do when a user applies pressure in an uncomfortable situation: a user insists, begs, flatters or grieves, and the model gives up a correct fact, writes a documen…
This Is a Good Paper, Right? How Tag Questions Affect Sycophancy Across 106 Language Models
Tapan Parikh
Whether a language model agrees with a user depends on how the user asks. We measure this on 106 models with a grid of three wordings and three cues, on 20 personal decisions, coun…
The One-Word Census: Answer-Choice Conformity Across 105 Language Models
Tapan Parikh
When a language model must choose one answer from a large space of equally valid options, which answer does it choose, and how often is it the answer every other model chooses? Ask…
Structured Output Collapses Answer Diversity Across 44 Language Models
Tapan Parikh
When a language model must choose one answer from a large space of equally valid options, a format clause -- "Reply with JSON only" -- changes which answer it chooses. We re-run th…
The Communal Loom: Integrating Tangible Interaction and Participatory Data Collection for Assessing Well-Being
Niti Parikh, Yiran Zhao, Maria Alinea-Bravo +1
For most health or well-being interventions, the process of evaluation is distinct from the activity itself, both in terms of who is involved, and how the actual data is collected…
'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs
Ishika Joshi, Ishita Gupta, Adrita Dey +1
Large Language Models (LLMs) are increasingly being used to generate text across various languages, for tasks such as translation, customer support, and education. Despite these ad…