Semantic Faithfulness and Entropy Production Measures to Tame Your LLM Demons and Manage Hallucinations

Igor Halperin

Evaluating faithfulness of Large Language Models (LLMs) to a given task is a complex challenge. We propose two new unsupervised metrics for faithfulness evaluation using insights f…