1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.CL2024
Calibrated Large Language Models for Binary Question Answering
Patrizio Giovannotti, Alexander Gammerman
Quantifying the uncertainty of predictions made by large language models (LLMs) in binary text classification tasks remains a challenge. Calibration, in the context of LLMs, refers…
cs.CL2023★ 1 cited
Evaluating Machine Translation Quality with Conformal Predictive Distributions
Patrizio Giovannotti
This paper presents a new approach for assessing uncertainty in machine translation by simultaneously evaluating translation quality and providing a reliable confidence score. Our…
cs.CL2022
Calibration of Natural Language Understanding Models with Venn--ABERS Predictors
Patrizio Giovannotti
Transformers, currently the state-of-the-art in natural language understanding (NLU) tasks, are prone to generate uncalibrated predictions or extreme probabilities, making the proc…