Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
The Surprising Effectiveness of Shared Memory in Looped Transformers
Giovanni Monea, Keshav Ramji, Yousef El-Kurdi +4
Looped Transformers apply the same layers several times per token, adding compute to improve quality without more parameters. Each recursion, however, writes its own key-value cach…
cs.LG2026
Learning to Predict Distributions over Weight Updates for Test-Time Adaptation
Azal Ahmad Khan, Keshav Ramji, Tahira Naseem +2
Hypernetworks have recently shown success in dynamically adapting the parameters of Large Language Models (LLMs) at runtime based on signals such as task descriptions or additional…