Cache2LoRA: Understanding and Improving Context Internalization

Yi Fang, Gaurav Srivastava, Zhenyu Bi +2

Context-to-LoRA methods encode documents as low-rank parameter updates, allowing language models to answer without retaining the source text in their decoding context. How reliably…