A statistically consistent measure of semantic uncertainty using Language Models

Yi Liu

To address the challenge of quantifying uncertainty in the outputs generated by language models, we propose a novel measure of semantic uncertainty, semantic spectral entropy, that…