ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs

Hang Yin, Haozhe Wang, Yuhua Luo +3

Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new tasks, and strict parameter bu…