Tracking Universal Features Through Fine-Tuning and Model Merging

Niels Horn, Desmond Elliott

We study how features emerge, disappear, and persist across models fine-tuned on different domains of text. More specifically, we start from a base one-layer Transformer language m…