SLM Meets LLM: Balancing Latency, Interpretability and Consistency in Hallucination Detection

Mengya Hu, Rui Xu, Deren Lei +5

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we…