From Evidence to Belief: A Bayesian Epistemology Approach to Language Models

Minsu Kim, Sangryul Kim, James Thorne

This paper investigates the knowledge of language models from the perspective of Bayesian epistemology. We explore how language models adjust their confidence and responses when pr…