224 citations · 597 across the 10 of their papers we have counts for
11 papers
CrossWeave: Bridging Perspectives Across Online Communities with a Dual-Pane Design
Fei Fang, Reva Hirave, William Jurayj +19
Social media systems typically display conversations among already familiar contributors, which can be predictable and one-sided. In civic discourse, this design narrows discussion…
Joint Prompt Optimization of Stacked LLMs using Variational Inference
Alessandro Sordoni, Xingdi Yuan, Marc-Alexandre Côté +6
Large language models (LLMs) can be seen as atomic units of computation mapping sequences to a distribution over sequences. Thus, they can be seen as stochastic language layers in…
Rethinking Model Evaluation as Narrowing the Socio-Technical Gap
Q. Vera Liao, Ziang Xiao
The recent development of generative large language models (LLMs) poses new challenges for model evaluation that the research community and industry have been grappling with. While…
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory
Ziang Xiao, Susu Zhang, Vivian Lai +1
We address a fundamental challenge in Natural Language Generation (NLG) model evaluation -- the design and evaluation of evaluation metrics. Recognizing the limitations of existing…
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games
Ruoyao Wang, Graham Todd, Eric Yuan +3
In this work, we investigate the capacity of language models to generate explicit, interpretable, and interactive world models of scientific and common-sense reasoning tasks. We op…
Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding
Ziang Xiao, Xingdi Yuan, Q. Vera Liao +2
Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when wo…
Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot
Ziang Xiao, Tiffany Wenting Li, Karrie Karahalios +1
Informed consent is a core cornerstone of ethics in human subject research. Through the informed consent process, participants learn about the study procedure, benefits, risks, and…
Powering an AI Chatbot with Expert Sourcing to Support Credible Health Information Access
Ziang Xiao, Q. Vera Liao, Michelle X. Zhou +2
During a public health crisis like the COVID-19 pandemic, a credible and easy-to-access information portal is highly desirable. It helps with disease prevention, public health plan…
What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys
Yubin Ge, Ziang Xiao, Jana Diesner +3
Generating follow-up questions on the fly could significantly improve conversational survey quality and user experiences by enabling a more dynamic and personalized survey structur…
If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills
Ziang Xiao, Michelle X. Zhou, Wenxi Chen +2
Interview chatbots engage users in a text-based conversation to draw out their views and opinions. It is, however, challenging to build effective interview chatbots that can handle…
Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions
Ziang Xiao, Michelle X. Zhou, Q. Vera Liao +4
The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user…