1 citations · 1 across the 5 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
A Step Towards Forgetting: Optimiser History and the Loss of Answer Mass
Valeria Ruscio, Seth Nabarro, Keiran Thompson
During fine-tuning, a language model can assign less probability to previously learned answers even when the current gradient acts to preserve that probability. With momentum, each…
cs.CL2023★ 1 cited
Attention-likelihood relationship in transformers
Valeria Ruscio, Valentino Maiorca, Fabrizio Silvestri
We analyze how large language models (LLMs) represent out-of-context words, investigating their reliance on the given context to capture their semantics. Our likelihood-guided text…