5 citations · 5 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Re-examining learning linear functions in context
Omar Naim, Guilhem Fouilhé, Nicholas Asher
In-context learning (ICL) has emerged as a powerful paradigm for easily adapting Large Language Models (LLMs) to various tasks. However, our understanding of how ICL works remains…
cs.CL2024★ 5 cited
On Explaining with Attention Matrices
Omar Naim, Nicholas Asher
This paper explores the much discussed, possible explanatory link between attention weights (AW) in transformer models and predicted output. Contrary to intuition and early researc…