4 papers
CIG: Measuring Conversational Information Gain in Deliberative Dialogues with Semantic Memory Dynamics
Ming-Bin Chen, Jey Han Lau, Lea Frermann
Measuring the quality of public deliberation requires evaluating not only civility or argument structure, but also the informational progress of a conversation. We introduce a fram…
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
Yanbei Jiang, Amr Keleg, Ryandito Diandaru +4
While the real world is inherently stochastic, Large Language Models (LLMs) are predominantly evaluated on single-round inference against fixed ground truths. In this work, we shif…
Moderation Matters:Measuring Conversational Moderation Impact in English as a Second Language Group Discussion
Rena Gao, Ming-Bin Chen, Lea Frermann +1
English as a Second Language (ESL) speakers often struggle to engage in group discussions due to language barriers. While moderators can facilitate participation, few studies asses…
WHoW: A Cross-domain Approach for Analysing Conversation Moderation
Ming-Bin Chen, Lea Frermann, Jey Han Lau
We propose WHoW, an evaluation framework for analyzing the facilitation strategies of moderators across different domains/scenarios by examining their motives (Why), dialogue acts…