Learning an Anchored Prompt Space for Continual Adaptation of Large Language Models

Rongguang Ye, Zhan Zhuang, Yichen Wu +2

Continually adapting large language models requires acquiring new knowledge while preserving previously learned capabilities. Although jointly adapting model parameters and task-sp…