Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs
Sheridan Feucht, David Atkinson, Byron Wallace +1
LLMs process text as sequences of tokens that roughly correspond to words, where less common words are represented by multiple tokens. However, individual tokens are often semantic…
cs.CL2024
Locating and Editing Factual Associations in Mamba
Arnab Sen Sharma, David Atkinson, David Bau
We investigate the mechanisms of factual recall in the Mamba state space model. Our work is inspired by previous findings in autoregressive transformer language models suggesting t…