most citedSimple linear attention language models balance the recall-throughput tradeoff

4 citations · 4 across the 3 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2025

Constructing Efficient Fact-Storing MLPs for Transformers

Owen Dugan, Roberto Garcia, Ronny Junkins +5

The success of large language models (LLMs) can be attributed in part to their ability to efficiently store factual knowledge as key-value mappings within their MLP parameters. Rec…