Reverse-Engineering Model Editing on Language Models

Zhiyu Sun, Minrui Luo, Yu Wang +2

Large language models (LLMs) are pretrained on corpora containing trillions of tokens and, therefore, inevitably memorize sensitive information. Locate-then-edit methods, as a main…