Factual Self-Awareness in Language Models: Representation, Robustness, and Scaling

Hovhannes Tamoyan, Subhabrata Dutta, Iryna Gurevych

Factual incorrectness in generated content is one of the primary concerns in ubiquitous deployment of large language models (LLMs). Prior findings suggest LLMs can (sometimes) dete…