CATTO: Balancing Preferences and Confidence in Language Models

Nisarg Parikh, Ananya Sai, Pannaga Shivaswamy +2

Large language models (LLMs) often make accurate next token predictions but their confidence in these predictions can be poorly calibrated: high-confidence predictions are frequent…