12 papers
When Do Multi-Agent Systems Help? An Information Bottleneck Perspective
Wendi Yu, Lianhao Zhou, Xiangjue Dong +6
LLM powered multi-agent systems (MAS) have emerged as a promising paradigm for complex tasks. However, their advantages over single-agent systems (SAS) remain unclear, with perform…
DisasterBench: Benchmarking LLM Planning under Typed Tool Interface Constraints
Zhitong Chen, Kai Yin, Weifeng Zhang +7
Disasters cause severe societal impacts, demanding rapid coordination of heterogeneous AI tools, from satellite analysis to flood prediction and damage assessment, into coherent mu…
Conversational Speech Reveals Structural Robustness Failures in SpeechLLM Backbones
Maria Teleki, Sai Janjur, Haoran Liu +11
LLMs serve as the backbone in SpeechLLMs, yet their behavior on spontaneous conversational input remains poorly understood. Conversational speech contains pervasive disfluencies --…
SocialPulse: An Open-Source Subreddit Sensemaking Toolkit
Stephanie Birkelbach, Maria Teleki, Peter Carragher +3
Understanding how online communities discuss and make sense of complex social issues is a central challenge in social media research, yet existing tools for large-scale discourse a…
DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management
Zhitong Chen, Kai Yin, Xiangjue Dong +7
Accurate question answering (QA) in disaster management requires reasoning over uncertain and conflicting information, a setting poorly captured by existing benchmarks built on cle…
DMRetriever: A Family of Models for Improved Text Retrieval in Disaster Management
Kai Yin, Xiangjue Dong, Chengkai Liu +4
Effective and efficient access to relevant information is essential for disaster management. However, no retrieval model is specialized for disaster management, and existing genera…