1 citations · 1 across the 2 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Transformer verbatim in-context retrieval across time and scale
Kristijan Armeni, Marko Pranjić, Senja Pollak
To predict upcoming text, language models must in some cases retrieve in-context information verbatim. In this report, we investigated how the ability of language models to retriev…
cs.CL2022★ 1 cited
Characterizing Verbatim Short-Term Memory in Neural Language Models
Kristijan Armeni, Christopher Honey, Tal Linzen
When a language model is trained to predict natural language sequences, its prediction at each moment depends on a representation of prior context. What kind of information about t…