Memory vs. Context? Influential Factors of Factual Recall in Language Models

Guilhem Fouilhé, Nicholas Asher, Philippe Muller

We reproduce and stress-test the work of Yu et al. (2023), who characterize how language models (LMs) arbitrate between memorized knowledge and contradictory in-context statements.…