Data Compressibility Quantifies LLM Memorization

Yizhan Huang, Zhe Yang, Meifang Chen +3

Large Language Models (LLMs) are known to memorize portions of their training data, sometimes even reproduce content verbatim when prompted appropriately. Despite substantial inter…