4 papers · 1 filter
Estimating Uncertainty from Reasoning: A Large-Scale Study of Multi- and Crosslingual MCQA Performance in LLMs
Andrea Bacciu, Andrea Alfarano, Saab Mansour +2
Uncertainty estimation (UE) enables LLM-powered systems to recognize when to abstain, yet existing research has predominantly focused on English. We present the first large-scale e…
Select, Label, Evaluate: Active Testing in NLP
Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu +2
Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requ…
Monte Carlo Temperature: a robust sampling strategy for LLM's uncertainty quantification methods
Nicola Cecere, Andrea Bacciu, Ignacio Fernández TobÃas +1
Uncertainty quantification (UQ) in Large Language Models (LLMs) is essential for their safe and reliable deployment, particularly in critical applications where incorrect outputs c…
Handling Ontology Gaps in Semantic Parsing
Andrea Bacciu, Marco Damonte, Marco Basaldella +1
The majority of Neural Semantic Parsing (NSP) models are developed with the assumption that there are no concepts outside the ones such models can represent with their target symbo…