The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigation

Alexander Xiong, Xuandong Zhao, Aneesh Pappu +1

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet they also exhibit memorization of their training data. This phenomenon rais…