56 citations · 79 across the 14 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023★ 4 cited
Function Vectors in Large Language Models
Eric Todd, Millicent L. Li, Arnab Sen Sharma +3
We report the presence of a simple neural mechanism that represents an input-output function as a vector within autoregressive transformer language models (LMs). Using causal media…
cs.CL2023★ 4 cited
Linearity of Relation Decoding in Transformer Language Models
Evan Hernandez, Arnab Sen Sharma, Tal Haklay +5
Much of the knowledge encoded in transformer language models (LMs) may be expressed in terms of relations: relations between words and their synonyms, entities and their attributes…