N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models

Donghoon Han, Minseop Jung, Dong Woo Kwak +2

Conditional memory expands language-model capacity through selective lookup, but the full embedding table must remain available for every possible input. We introduce Conditional P…