4 citations · 10 across the 7 of their papers we have counts for
7 papers
Gricea: An Open Science Platform for Conversational AI Research
Nikhil Sharma, Yunlin Gong, Xinyang Cheng +1
We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders rep…
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
Susanne Gaube, Markus Langer, Tim Miller +17
The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human…
Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild
Willem van der Maden, Malak Sadek, Ziang Xiao +3
How do product teams evaluate LLM-powered products? As organizations integrate large language models (LLMs) into digital products, their unpredictable nature makes traditional eval…
Faux Polyglot: A Study on Information Disparity in Multilingual Large Language Models
Nikhil Sharma, Kenton Murray, Ziang Xiao
Although the multilingual capability of LLMs offers new opportunities to overcome the language barrier, do these capabilities translate into real-life scenarios where linguistic di…
ECBD: Evidence-Centered Benchmark Design for NLP
Yu Lu Liu, Su Lin Blodgett, Jackie Chi Kit Cheung +3
Benchmarking is seen as critical to assessing progress in NLP. However, creating a benchmark involves many design decisions (e.g., which datasets to include, which metrics to use)…
Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seeking
Nikhil Sharma, Q. Vera Liao, Ziang Xiao
Large language models (LLMs) powered conversational search systems have already been used by hundreds of millions of people, and are believed to bring many benefits over convention…
Canvil: Designerly Adaptation for LLM-Powered User Experiences
K. J. Kevin Feng, Q. Vera Liao, Ziang Xiao +3
Advancements in large language models (LLMs) are sparking a proliferation of LLM-powered user experiences (UX). In product teams, designers often craft UX to meet user needs, but i…