3 papers
cs.CL2026
SpeakerSleuth: Can Large Audio-Language Models Judge Speaker Consistency across Multi-turn Dialogues?
Jonggeun Lee, Junseong Pyo, Gyuhyeon Seo +1
Large Audio-Language Models (LALMs) as judges have emerged as a prominent approach for evaluating speech generation quality, yet their ability to assess speaker consistency across…
cs.CL2026
SpokenUS: A Spoken User Simulator for Task-Oriented Dialogue
Jonggeun Lee, Junseong Pyo, Jeongmin Park +1
Robust task-oriented spoken dialogue agents require exposure to the full diversity of how people interact through speech. Building spoken user simulators that address this requires…
cs.CL2026
SimuHome: A Temporal- and Environment-Aware Benchmark for Smart Home LLM Agents
Gyuhyeon Seo, Jungwoo Yang, Junseong Pyo +3
We introduce , a high-fidelity smart home simulator and a benchmark of 600 episodes for LLM-based smart home agents. Existing smart home benchmarks treat the hom…