Understanding LoRA as Knowledge Memory: An Empirical Analysis

Seungju Back, Dongwoo Lee, Naun Kang +4

Continuous knowledge updating for pre-trained large language models (LLMs) is increasingly necessary yet remains challenging. Although inference-time methods like In-Context Learni…