InnerThoughts: Disentangling Representations and Predictions in Large Language Models

Didier Chételat, Joseph Cotnareanu, Rylee Thompson +2

Large language models (LLMs) contain substantial factual knowledge which is commonly elicited by multiple-choice question-answering prompts. Internally, such models process the pro…