Pruning as a Defense: Reducing Memorization in Large Language Models

Mansi Gupta, Nikhar Waghela, Sarthak Gupta +2

Large language models have been shown to memorize significant portions of their training data, which they can reproduce when appropriately prompted. This work investigates the impa…