57 citations · 90 across the 14 of their papers we have counts for
4 papers · 1 filter
Wiki-Talkie: Multilingual Benchmarking of Persona-Based Agents on Real-World Discussions
Dennis Fucci, Andrea Bacciu, Dong Liu +2
LLMs are increasingly deployed as autonomous agents in social environments, making it critical to study their ability to faithfully simulate human interactions. Central to this is…
QUORUM: QUality-Optimized Routing Using Multiple annotators
Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu +2
Data annotation remains a central bottleneck in natural language processing, requiring human effort to obtain high-quality labels at scale. While Large Language Models (LLMs) offer…
Estimating Uncertainty from Reasoning: A Large-Scale Study of Multi- and Crosslingual MCQA Performance in LLMs
Andrea Alfarano, Andrea Bacciu, Saab Mansour +2
Uncertainty estimation (UE) enables LLM-powered systems to recognize when to abstain, yet existing research has predominantly focused on English. We present the first large-scale e…
Select, Label, Evaluate: Active Testing in NLP
Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu +2
Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requ…