From token probabilities to calibrated confidence: An empirical study of mathematical question answering

Avery Ma, Lorne Schell, Vin Bhaskara +1

Confidence estimation for large language models (LLMs) aims to estimate the probability that a generated answer is correct, while calibration aligns these estimates with empirical…