21 citations · 42 across the 14 of their papers we have counts for
15 papers
Self-Reported Side Effects of Semaglutide and Tirzepatide in Online Communities
Neil K. R. Sehgal, Jena Shaw Tronieri, Lyle Ungar +1
Social media can reveal patient experiences with glucagon-like peptide-1 receptor agonists (GLP-1 RAs) that extend beyond clinical trial data. We analyzed 410,198 Reddit posts (May…
Knowing When Not to Answer: Lightweight KB-Aligned OOD Detection for Safe RAG
Ilias Triantafyllopoulos, Renyi Qu, Salvatore Giorgi +3
Retrieval-Augmented Generation (RAG) systems are increasingly deployed in high-stakes domains, where safety depends not only on how a system answers, but also on whether a query sh…
The Illusion of Empathy: How AI Chatbots Shape Conversation Perception
Tingting Liu, Salvatore Giorgi, Ankit Aich +4
As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explo…
DiverseDialogue: A Methodology for Designing Chatbots with Human-Like Diversity
Xiaoyu Lin, Xinkai Yu, Ankit Aich +2
Large Language Models (LLMs), which simulate human users, are frequently employed to evaluate chatbots in applications such as tutoring and customer service. Effective evaluation n…
Vernacular? I Barely Know Her: Challenges with Style Control and Stereotyping
Ankit Aich, Tingting Liu, Salvatore Giorgi +3
Large Language Models (LLMs) are increasingly being used in educational and learning applications. Research has demonstrated that controlling for style, to fit the needs of the lea…
Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas
Salvatore Giorgi, Tingting Liu, Ankit Aich +6
Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. Howeve…
Building Knowledge-Guided Lexica to Model Cultural Variation
Shreya Havaldar, Salvatore Giorgi, Sunny Rai +4
Cultural variation exists between nations (e.g., the United States vs. China), but also within regions (e.g., California vs. Texas, Los Angeles vs. San Francisco). Measuring this r…
Cross-Cultural Differences in Mental Health Expressions on Social Media
Sunny Rai, Khushi Shelat, Devansh R Jain +6
Culture moderates the way individuals perceive and express mental distress. Current understandings of mental health expressions on social media, however, are predominantly derived…
Language-based Valence and Arousal Expressions between the United States and China: a Cross-Cultural Examination
Young-Min Cho, Dandan Pang, Stuti Thapa +4
While affective expressions on social media have been extensively studied, most research has focused on the Western context. This paper explores cultural differences in affective e…
Historical patterns of rice farming explain modern-day language use in China and Japan more than modernization and urbanization
Sharath Chandra Guntuku, Thomas Talhelm, Garrick Sherman +4
We used natural language processing to analyze a billion words to study cultural differences on Weibo, one of China's largest social media platforms. We compared predictions from t…
Psychological Metrics for Dialog System Evaluation
Salvatore Giorgi, Shreya Havaldar, Farhan Ahmed +6
We present metrics for evaluating dialog systems through a psychologically-grounded "human" lens in which conversational agents express a diversity of both states (e.g., emotion) a…
A Holistic Framework for Analyzing the COVID-19 Vaccine Debate
Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan +4
The Covid-19 pandemic has led to infodemic of low quality information leading to poor health decisions. Combating the outcomes of this infodemic is not only a question of identifyi…
Different Affordances on Facebook and SMS Text Messaging Do Not Impede Generalization of Language-Based Predictive Models
Tingting Liu, Salvatore Giorgi, Xiangyu Tao +4
Adaptive mobile device-based health interventions often use machine learning models trained on non-mobile device data, such as social media text, due to the difficulty and high exp…
Prospective Learning: Principled Extrapolation to the Future
Ashwin De Silva, Rahul Ramesh, Lyle Ungar +40
Learning is a process which can update decision rules, based on past experience, such that future performance improves. Traditionally, machine learning is often evaluated under the…
Combining Probability Forecasts and Understanding Probability Extremizing through Information Diversity
Ville Satopää, Robin Pemantle, Lyle Ungar
Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity s…