A Step Towards Forgetting: Optimiser History and the Loss of Answer Mass

Valeria Ruscio, Seth Nabarro, Keiran Thompson

During fine-tuning, a language model can assign less probability to previously learned answers even when the current gradient acts to preserve that probability. With momentum, each…