39 citations · 39 across the 5 of their papers we have counts for
1 paper · 1 filter
Tony Mason
The context window of a large language model is not memory. It is L1 cache: a small, fast, expensive resource that the field treats as the entire memory system. There is no L2, no…