Learning to Interpret Weight Differences in Language Models

Avichal Goel, Yoon Kim, Nir Shavit +1

Finetuning (pretrained) language models is a standard approach for updating their internal parametric knowledge and specializing them to new tasks and domains. However, the corresp…