2 citations · 2 across the 5 of their papers we have counts for
5 papers
Clinician-Grounded Quality Assurance for AI-Assisted Psychiatric Intake
King Shi, Amanda Li, Jonathan Ivey +7
Before patients can use AI-assisted psychiatric intake systems, health systems need practical ways to routinely evaluate these tools against their clinical standards for quality as…
What Makes a Good Response? An Empirical Analysis of Quality in Qualitative Interviews
Jonathan Ivey, Anjalie Field, Ziang Xiao
Qualitative interviews provide essential insights into human experiences when they elicit high-quality responses. While qualitative and NLP researchers have proposed various measur…
NUTMEG: Separating Signal From Noise in Annotator Disagreement
Jonathan Ivey, Susan Gauch, David Jurgens
NLP models often rely on human-labeled data for training and evaluation. Many approaches crowdsource this data from a large number of annotators with varying skills, backgrounds, a…
Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Dialogue
Jonathan Ivey, Shivani Kumar, Jiayu Liu +12
Studying and building datasets for dialogue tasks is both expensive and time-consuming due to the need to recruit, train, and collect data from study participants. In response, muc…
Improving Minority Stress Detection with Emotions
Jonathan Ivey, Susan Gauch
Psychological stress detection is an important task for mental healthcare research, but there has been little prior work investigating the effectiveness of psychological stress mod…