PReM: Learning What to Preserve and When to Refresh for Context Compression

Bohan Yu, Lei Shen, Chenxi Zhou +5

The paper proposes PReM, a framework that lets language models dynamically decide which parts of a long context to keep and when to refresh stored information, improving efficiency…