21 citations · 42 across the 14 of their papers we have counts for
9 papers · 1 filter
Knowing When Not to Answer: Lightweight KB-Aligned OOD Detection for Safe RAG
Ilias Triantafyllopoulos, Renyi Qu, Salvatore Giorgi +3
Retrieval-Augmented Generation (RAG) systems are increasingly deployed in high-stakes domains, where safety depends not only on how a system answers, but also on whether a query sh…
DiverseDialogue: A Methodology for Designing Chatbots with Human-Like Diversity
Xiaoyu Lin, Xinkai Yu, Ankit Aich +2
Large Language Models (LLMs), which simulate human users, are frequently employed to evaluate chatbots in applications such as tutoring and customer service. Effective evaluation n…
Vernacular? I Barely Know Her: Challenges with Style Control and Stereotyping
Ankit Aich, Tingting Liu, Salvatore Giorgi +3
Large Language Models (LLMs) are increasingly being used in educational and learning applications. Research has demonstrated that controlling for style, to fit the needs of the lea…
Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas
Salvatore Giorgi, Tingting Liu, Ankit Aich +6
Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. Howeve…
Building Knowledge-Guided Lexica to Model Cultural Variation
Shreya Havaldar, Salvatore Giorgi, Sunny Rai +4
Cultural variation exists between nations (e.g., the United States vs. China), but also within regions (e.g., California vs. Texas, Los Angeles vs. San Francisco). Measuring this r…
Historical patterns of rice farming explain modern-day language use in China and Japan more than modernization and urbanization
Sharath Chandra Guntuku, Thomas Talhelm, Garrick Sherman +4
We used natural language processing to analyze a billion words to study cultural differences on Weibo, one of China's largest social media platforms. We compared predictions from t…
Psychological Metrics for Dialog System Evaluation
Salvatore Giorgi, Shreya Havaldar, Farhan Ahmed +6
We present metrics for evaluating dialog systems through a psychologically-grounded "human" lens in which conversational agents express a diversity of both states (e.g., emotion) a…
A Holistic Framework for Analyzing the COVID-19 Vaccine Debate
Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan +4
The Covid-19 pandemic has led to infodemic of low quality information leading to poor health decisions. Combating the outcomes of this infodemic is not only a question of identifyi…
Different Affordances on Facebook and SMS Text Messaging Do Not Impede Generalization of Language-Based Predictive Models
Tingting Liu, Salvatore Giorgi, Xiangyu Tao +4
Adaptive mobile device-based health interventions often use machine learning models trained on non-mobile device data, such as social media text, due to the difficulty and high exp…