Rethinking Memorization Measures and their Implications in Large Language Models

Bishwamittra Ghosh, Soumi Das, Qinyuan Wu +4

Concerned with privacy threats, memorization in LLMs is often seen as undesirable, specifically for learning. In this paper, we study whether memorization can be avoided when optim…