Evaluating Context Compaction on the Questions That Come Later

Junwei Yao, Yongxi Zhou, Zike Yang +4

Language-model agents compact their context for the question at hand, but the compacted context must also serve questions that come later. We evaluate compaction on these later que…