Dist2ill: Distributional Distillation for One-Pass Uncertainty Estimation in Large Language Models

Yicong Zhao, King Yeung Tsang, Harshil Vejendla +9

Large Language Models (LLMs) often exhibit misalignment between the quality of their generated responses and the confidence estimates they assign to them. Bayesian treatments, such…