Improved Confidence Estimates for Black-Box Large Language Models

Sokhna Diarra Mbacke, Mouloud Belbahri, Gabriel Loaiza-Ganem

Uncertainty quantification (UQ) is essential for the safe deployment of large language models (LLMs). Existing methods, from verbalized confidence to ones requiring multiple genera…