Context Distillation as Latent Memory Management

Ziyang Zheng, Zeju Li, Xiangyu Wen +5

Context distillation compresses contextual information into model parameters, yet existing methods often ignore how multiple distilled latent memories should be stored, retrieved,…