works on
context compression 1kv cache 1long-context inference 1memory selection 1model efficiency 1

From the 1 of 1 linked paper with an AI index.

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2026

PReM: Learning What to Preserve and When to Refresh for Context Compression

Bohan Yu, Lei Shen, Chenxi Zhou +5

The paper proposes PReM, a framework that lets language models dynamically decide which parts of a long context to keep and when to refresh stored information, improving efficiency…