Gradients with Respect to Semantics Preserving Embeddings Tell the Uncertainty of Large Language Models

Mingda Li, Rundong Lv, Xinyu Li +2

Uncertainty quantification (UQ) is an important technique for ensuring the trustworthiness of LLMs, given their tendency to hallucinate. Existing state-of-the-art UQ approaches for…