FictionalQA: A Dataset for Studying Memorization and Knowledge Acquisition

John Kirchenbauer, Janny Mongkolsupawan, Yuxin Wen +2

When language models are trained on textual data, they acquire both knowledge about the structure of language as well as knowledge of facts about the world. At inference time, thei…