Context Memorization for Efficient Long Context Generation

Yasuyuki Okoshi, Hao Mark Chen, Guanxi Lu +3

Modern large language model (LLM) applications increasingly rely on long conditioning prefixes to control model behavior at inference time. While prefix-augmented inference is effe…