What It Costs to Compose, Rebuild, and Correct Precomputed Memory

Asa Shepard

Language models can answer from precomputed memory, a model's saved reading of a body of material, reused across requests instead of read again at each. This paper maps where that…