From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge

Wenkang Wei, Yuan Fang, Renhe Jiang +2

How does a language model's dependence on query-routing information and target knowledge change as it answers a question? We study this question through layerwise interventions on…